2024-09-21T04:38:00.208 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T04:38:00.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T04:38:00.327 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729 branch: wip-guits-main-2024-09-20-2310 description: orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} email: gabrioux@ibm.com first_in_suite: false job_id: '7913729' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-guits-main-2024-09-20-2310 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_STRAY_DAEMON - CEPHADM_FAILED_DAEMON - CEPHADM_AGENT_DOWN log-only-match: - CEPHADM_ sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 workunit: branch: wip-guits-main-2024-09-20-2310 sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 3363 sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-20-2310 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNSPixSadHm7BZBTJVmQecmZQPlI+wmW3FfHrtD4eokMss4F1FjXz8tmWvT51Gg2ZvtWY2GYMVKlMzF3Dlzwgyo= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnq0kmJ5ZTzofJ9Lthlr5Fkn8fJu38+81dEqw1nLx7AJtOgVPSRmJjW+XxCCQcO5J6rR7RfU6SRyASNclOkAwE= tasks: - cephadm: compiled_cephadm_branch: squid image: quay.ceph.io/ceph-ci/ceph:squid - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 180 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch ps - ceph versions - ceph -s - ceph orch ls - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 2' - ceph mgr fail - sleep 180 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph health detail - ceph -s - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 1' - ceph mgr fail - sleep 180 - ceph orch ps - ceph orch ls - ceph versions - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 1' - ceph versions | jq -e '.mon | keys' | grep $sha1 - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 5' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 7' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 8' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 1' - ceph versions | jq -e '.osd | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.foo - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.rgw | length == 1' - ceph versions | jq -e '.rgw | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_03:44:43 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T04:38:00.327 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa; will attempt to use it 2024-09-21T04:38:00.328 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa/tasks 2024-09-21T04:38:00.328 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T04:38:00.329 INFO:teuthology.task.internal:Checking packages... 2024-09-21T04:38:00.349 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2' 2024-09-21T04:38:00.349 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T04:38:00.349 INFO:teuthology.packaging:ref: None 2024-09-21T04:38:00.350 INFO:teuthology.packaging:tag: None 2024-09-21T04:38:00.350 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-20-2310 2024-09-21T04:38:00.350 INFO:teuthology.packaging:sha1: f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T04:38:00.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-guits-main-2024-09-20-2310 2024-09-21T04:38:00.496 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5103-gf36283e7-1jammy 2024-09-21T04:38:00.497 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T04:38:00.510 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T04:38:00.510 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T04:38:00.547 INFO:teuthology.task.internal:Saving configuration 2024-09-21T04:38:00.565 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T04:38:00.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T04:38:00.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 04:32:15.389622', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICW+CEd3+ukp7ZsPnK1Cc9CR3AiCNZG8+bgVSLbK3Y/D'} 2024-09-21T04:38:00.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 04:32:15.391063', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKzhScC/nRMUgz3EdjGdJngvX8y5zjja/A9Z3+UyCF6D'} 2024-09-21T04:38:00.621 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T04:38:00.630 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-09-21T04:38:00.630 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-09-21T04:38:00.630 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T04:38:00.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f826d4cc280>, signals=[15]) 2024-09-21T04:38:00.687 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T04:38:00.693 INFO:teuthology.task.internal:Opening connections... 2024-09-21T04:38:00.693 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T04:38:00.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:38:00.770 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-21T04:38:00.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:38:00.847 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T04:38:00.853 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-21T04:38:00.859 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-21T04:38:00.859 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-21T04:38:00.909 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T04:38:00.909 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2024-09-21T04:38:00.909 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T04:38:00.910 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2024-09-21T04:38:00.911 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-21T04:38:00.931 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-21T04:38:00.937 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-21T04:38:00.937 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-09-21T04:38:00.981 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T04:38:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T04:38:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T04:38:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T04:38:00.982 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-09-21T04:38:00.982 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-21T04:38:01.006 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T04:38:01.015 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T04:38:01.021 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T04:38:01.021 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-21T04:38:01.023 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-21T04:38:01.028 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T04:38:01.038 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T04:38:01.038 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-21T04:38:01.071 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-21T04:38:01.087 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T04:38:01.142 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T04:38:01.155 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T04:38:01.156 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T04:38:01.156 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T04:38:01.156 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T04:38:01.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:38:01.161 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T04:38:01.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:38:01.161 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-21T04:38:01.209 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-56-generic 2024-09-21T04:38:01.210 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.15.0-56-generic 2024-09-21T04:38:01.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-09-21T04:38:01.211 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-09-21T04:38:01.211 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-09-21T04:38:01.211 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-21T04:38:01.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-09-21T04:38:01.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-21T04:38:01.492 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T04:38:01.609 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T04:38:01.656 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T04:38:01.656 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T04:38:01.690 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T04:38:01.707 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T04:38:01.713 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T04:38:01.786 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T04:38:01.825 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T04:38:01.827 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T04:38:01.827 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T04:38:01.827 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T04:38:01.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T04:38:01.849 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T04:38:01.849 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T04:38:01.854 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T04:38:01.859 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T04:38:01.860 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T04:38:01.861 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T04:38:01.877 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T04:38:01.878 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T04:38:01.878 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T04:38:02.046 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T04:38:02.069 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T04:38:02.082 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T04:38:02.185 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T04:38:02.208 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T04:38:02.380 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T04:38:02.412 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T04:38:02.505 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T04:38:02.521 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T04:38:02.530 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T04:38:02.530 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T04:38:02.532 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T04:38:02.540 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T04:38:02.554 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T04:38:02.554 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T04:38:02.563 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T04:38:02.577 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T04:38:02.577 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T04:38:02.624 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T04:38:02.625 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T04:38:02.628 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T04:38:02.639 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T04:38:02.639 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T04:38:02.644 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T04:38:02.644 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T04:38:02.647 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T04:38:02.675 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T04:38:02.685 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T04:38:02.685 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T04:38:02.692 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T04:38:02.693 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T04:38:02.693 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T04:38:02.698 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T04:38:02.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T04:38:02.704 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T04:38:02.704 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T04:38:02.704 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T04:38:02.705 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T04:38:02.705 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T04:38:02.706 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T04:38:02.706 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T04:38:02.724 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T04:38:02.728 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T04:38:02.729 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T04:38:02.730 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T04:38:02.771 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T04:38:02.775 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T04:38:02.776 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T04:38:02.776 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T04:38:02.777 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T04:38:02.779 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T04:38:02.785 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T04:38:02.785 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T04:38:02.786 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T04:38:02.808 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T04:38:02.809 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T04:38:02.809 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T04:38:02.810 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T04:38:02.811 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T04:38:02.867 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T04:38:02.867 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T04:38:02.890 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T04:38:02.890 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T04:38:02.891 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T04:38:02.891 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T04:38:02.892 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T04:38:08.128 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 16.3 MB in 2s (7,523 kB/s) 2024-09-21T04:38:08.831 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 16.3 MB in 3s (5,870 kB/s) 2024-09-21T04:38:09.528 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-21T04:38:09.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T04:38:09.607 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-21T04:38:09.820 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-09-21T04:38:09.820 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-09-21T04:38:09.999 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T04:38:09.999 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T04:38:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T04:38:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T04:38:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T04:38:10.000 INFO:teuthology.orchestra.run.smithi089.stdout: python2.7-minimal 2024-09-21T04:38:10.000 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T04:38:10.001 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2024-09-21T04:38:10.001 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T04:38:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T04:38:10.002 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T04:38:10.003 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2024-09-21T04:38:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T04:38:10.003 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2024-09-21T04:38:10.003 INFO:teuthology.orchestra.run.smithi089.stdout: thermald 2024-09-21T04:38:10.057 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2024-09-21T04:38:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T04:38:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T04:38:10.057 INFO:teuthology.orchestra.run.smithi089.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T04:38:10.059 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2024-09-21T04:38:10.059 INFO:teuthology.orchestra.run.smithi089.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T04:38:10.238 INFO:teuthology.orchestra.run.smithi089.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T04:38:10.239 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 113 MB of archives. 2024-09-21T04:38:10.239 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T04:38:10.239 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T04:38:10.283 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-21T04:38:10.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T04:38:10.365 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-21T04:38:10.578 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-21T04:38:10.578 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-21T04:38:10.766 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T04:38:10.766 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T04:38:10.766 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T04:38:10.767 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T04:38:10.767 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T04:38:10.767 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-09-21T04:38:10.767 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T04:38:10.768 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-09-21T04:38:10.768 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T04:38:10.768 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T04:38:10.769 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T04:38:10.770 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-09-21T04:38:10.770 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T04:38:10.770 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-09-21T04:38:10.770 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-09-21T04:38:10.818 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-09-21T04:38:10.818 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T04:38:10.818 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T04:38:10.818 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T04:38:10.820 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-09-21T04:38:10.820 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T04:38:10.999 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T04:38:10.999 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-09-21T04:38:10.999 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T04:38:11.000 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T04:38:11.652 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T04:38:12.005 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T04:38:12.399 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T04:38:12.751 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T04:38:14.248 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T04:38:14.248 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T04:38:14.248 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T04:38:14.601 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T04:38:14.681 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T04:38:14.923 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T04:38:14.924 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T04:38:14.924 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T04:38:15.113 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-21T04:38:15.316 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T04:38:15.363 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T04:38:15.386 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T04:38:15.768 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 5s (25.0 MB/s) 2024-09-21T04:38:15.978 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T04:38:17.388 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T04:38:17.393 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:17.450 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:17.978 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T04:38:17.982 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:18.185 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:19.702 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T04:38:19.723 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:19.806 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:20.297 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T04:38:20.318 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:20.388 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:20.838 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T04:38:20.858 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:20.922 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:21.407 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T04:38:21.428 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:21.482 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:26.991 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:27.099 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:27.424 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:27.545 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:27.840 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T04:38:27.862 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T04:38:27.897 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T04:38:28.427 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:28.555 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:28.896 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:29.042 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:29.395 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T04:38:29.417 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T04:38:29.453 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T04:38:33.589 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T04:38:33.625 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:33.663 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:35.750 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T04:38:35.787 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T04:38:35.867 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:36.312 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:36.445 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:36.794 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T04:38:36.916 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:37.862 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T04:38:38.047 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:39.358 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:38:39.359 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T04:38:39.359 INFO:teuthology.orchestra.run.smithi089.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:38:39.359 INFO:teuthology.orchestra.run.smithi089.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T04:38:39.524 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:39.897 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T04:38:40.022 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T04:38:40.464 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T04:38:40.594 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:40.703 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T04:38:40.840 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:40.926 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T04:38:41.052 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T04:38:41.695 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:42.158 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:38:42.158 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T04:38:42.159 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:38:42.159 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T04:38:42.343 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:43.756 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:43.825 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T04:38:43.825 INFO:teuthology.orchestra.run.smithi089.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:38:44.168 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T04:38:44.270 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T04:38:44.405 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:45.823 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T04:38:45.882 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T04:38:45.882 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:38:57.734 INFO:teuthology.orchestra.run.smithi089.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T04:38:57.734 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub' 2024-09-21T04:38:57.750 INFO:teuthology.orchestra.run.smithi089.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T04:38:57.768 INFO:teuthology.orchestra.run.smithi089.stdout:Generating grub configuration file ... 2024-09-21T04:38:58.062 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:38:58.081 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:38:58.393 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:38:58.399 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T04:38:58.472 INFO:teuthology.orchestra.run.smithi089.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T04:38:58.478 INFO:teuthology.orchestra.run.smithi089.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T04:38:58.647 INFO:teuthology.orchestra.run.smithi089.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T04:38:58.647 INFO:teuthology.orchestra.run.smithi089.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T04:38:58.647 INFO:teuthology.orchestra.run.smithi089.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T04:38:58.688 INFO:teuthology.orchestra.run.smithi089.stdout:done 2024-09-21T04:38:59.202 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T04:38:59.267 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.122.122 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-09-21T04:38:59.268 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-09-21T04:38:59.268 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T04:38:59.268 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T04:38:59.268 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T04:38:59.268 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T04:38:59.268 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T04:38:59.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get clean 2024-09-21T04:38:59.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2024-09-21T04:38:59.513 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T04:38:59.637 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T04:38:59.721 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T04:38:59.800 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T04:39:00.383 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T04:39:00.383 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-09-21T04:39:00.408 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T04:39:00.426 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-09-21T04:39:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:39:00.865 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:39:00.971 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-21T04:39:00.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T04:39:01.042 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2024-09-21T04:39:01.237 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2024-09-21T04:39:01.237 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2024-09-21T04:39:01.317 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:39:01.323 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T04:39:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T04:39:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T04:39:01.404 INFO:teuthology.orchestra.run.smithi089.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T04:39:01.404 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T04:39:01.405 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T04:39:01.446 INFO:teuthology.orchestra.run.smithi089.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T04:39:01.448 DEBUG:teuthology.orchestra.run.smithi089:> dpkg -s linux-image-generic 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Package: linux-image-generic 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Status: install ok installed 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Priority: optional 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Section: kernel 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Installed-Size: 21 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: amd64 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Source: linux-meta 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Version: 5.15.0.122.122 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T04:39:01.507 INFO:teuthology.orchestra.run.smithi089.stdout:Recommends: thermald 2024-09-21T04:39:01.508 INFO:teuthology.orchestra.run.smithi089.stdout:Description: Generic Linux kernel image 2024-09-21T04:39:01.508 INFO:teuthology.orchestra.run.smithi089.stdout: This package will always depend on the latest generic kernel image 2024-09-21T04:39:01.508 INFO:teuthology.orchestra.run.smithi089.stdout: available. 2024-09-21T04:39:01.508 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-21T04:39:01.551 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T04:39:01.551 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T04:39:01.551 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T04:39:01.552 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.osaOF1LOyg 2024-09-21T04:39:01.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub/grub.cfg /tmp/tmp.osaOF1LOyg 2024-09-21T04:39:01.591 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-09-21T04:39:01.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.osaOF1LOyg 2024-09-21T04:39:01.722 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.osaOF1LOyg is 10KB 2024-09-21T04:39:01.735 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.osaOF1LOyg 2024-09-21T04:39:01.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T04:39:01.796 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:39:01.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T04:39:01.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T04:39:01.875 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T04:39:01.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo update-grub 2024-09-21T04:39:02.093 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-21T04:39:02.114 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-21T04:39:02.114 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.122.122 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-21T04:39:02.115 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-21T04:39:02.116 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T04:39:02.116 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T04:39:02.116 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T04:39:02.116 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T04:39:02.116 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T04:39:02.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-21T04:39:02.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-21T04:39:02.440 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T04:39:02.440 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T04:39:02.447 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T04:39:02.464 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T04:39:03.141 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2024-09-21T04:39:03.141 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T04:39:03.144 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-21T04:39:03.347 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:39:03.353 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:39:03.639 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:39:03.643 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T04:39:03.686 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T04:39:03.692 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T04:39:03.842 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T04:39:03.842 INFO:teuthology.orchestra.run.smithi089.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T04:39:03.842 INFO:teuthology.orchestra.run.smithi089.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T04:39:03.857 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-21T04:39:03.861 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-21T04:39:03.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-21T04:39:03.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T04:39:03.940 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-21T04:39:04.151 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-21T04:39:04.151 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-21T04:39:04.320 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T04:39:04.321 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T04:39:04.362 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T04:39:04.364 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-21T04:39:04.376 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.122.122 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-21T04:39:04.377 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-21T04:39:04.377 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-21T04:39:04.420 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.b4Bo5vQght 2024-09-21T04:39:04.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.b4Bo5vQght 2024-09-21T04:39:04.474 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.b4Bo5vQght 2024-09-21T04:39:04.594 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.b4Bo5vQght is 10KB 2024-09-21T04:39:04.606 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.b4Bo5vQght 2024-09-21T04:39:04.610 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T04:39:04.661 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:39:04.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T04:39:04.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T04:39:04.723 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T04:39:04.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-09-21T04:39:06.229 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-09-21T04:39:06.231 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T04:39:06.240 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-21T04:39:06.499 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T04:39:06.505 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T04:39:06.800 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T04:39:06.805 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T04:39:06.845 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T04:39:06.850 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T04:39:06.970 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T04:39:06.970 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T04:39:06.970 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T04:39:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-21T04:39:06.991 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-21T04:39:33.904 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T04:39:33.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:39:33.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:39:37.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T04:39:37.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:39:37.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:39:52.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T04:39:55.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-21T04:40:01.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:40:01.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:40:04.371 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T04:40:04.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:40:04.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:40:07.443 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-21T04:40:16.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:40:16.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:40:19.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:40:19.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:40:34.799 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T04:40:49.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:40:49.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:40:50.269 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T04:40:51.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:40:51.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-21T04:40:51.113 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T04:40:51.161 INFO:teuthology.orchestra.run.smithi089.stdout:5.15.0-122-generic 2024-09-21T04:40:51.162 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T04:40:51.162 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T04:40:51.162 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T04:40:51.249 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-21T04:40:52.162 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T04:40:52.163 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T04:40:52.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:40:52.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-21T04:40:52.267 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-21T04:40:52.272 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-122-generic 2024-09-21T04:40:52.272 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T04:40:52.272 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T04:40:52.272 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T04:40:52.434 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-21T04:40:52.480 DEBUG:teuthology.parallel:result is None 2024-09-21T04:40:53.273 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T04:40:53.273 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T04:40:53.367 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-21T04:40:53.388 DEBUG:teuthology.parallel:result is None 2024-09-21T04:40:53.388 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T04:40:53.409 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T04:40:53.409 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T04:40:53.412 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T04:40:53.419 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T04:40:53.478 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T04:40:53.490 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T04:40:53.490 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T04:40:53.492 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T04:40:53.518 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T04:40:53.524 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T04:40:53.524 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T04:40:53.555 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T04:40:53.570 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T04:40:53.578 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T04:40:53.580 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T04:40:53.588 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T04:40:53.589 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T04:40:53.596 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T04:40:53.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T04:40:53.622 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T04:40:53.644 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T04:40:53.652 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T04:40:53.653 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T04:40:53.679 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T04:40:53.693 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T04:40:53.730 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T04:40:53.778 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:40:53.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T04:40:53.946 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T04:40:53.952 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T04:40:54.001 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:40:54.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T04:40:54.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-21T04:40:54.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-21T04:40:54.171 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T04:40:54.179 INFO:teuthology.task.internal:Starting timer... 2024-09-21T04:40:54.180 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T04:40:54.190 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T04:40:54.199 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2024-09-21T04:40:54.199 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-09-21T04:40:54.200 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T04:40:54.200 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-21T04:40:54.200 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T04:40:54.200 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T04:40:54.211 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T04:40:54.221 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T04:40:54.222 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T04:48:23.244 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-09-21T04:48:23.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:48:23.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:48:23.324 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T04:48:23.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T04:48:23.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:48:23.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T04:48:23.480 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-21T04:48:23.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-21T04:48:23.559 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T04:48:23.577 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T04:48:23.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T04:48:23.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:48:23.580 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T04:48:23.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:48:23.607 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Command line: ntpd -gq 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: ---------------------------------------------------- 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-21T04:48:23.608 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: ---------------------------------------------------- 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: proto: precision = 0.060 usec (-24) 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: basedate set to 2022-02-04 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T04:48:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T04:48:23.610 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2024-09-21T04:48:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:23 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-21T04:48:23.623 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T04:48:23.623 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Command line: ntpd -gq 2024-09-21T04:48:23.623 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: ---------------------------------------------------- 2024-09-21T04:48:23.623 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: corporation. Support and training for ntp-4 are 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: available at https://www.nwtime.org/support 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: ---------------------------------------------------- 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: proto: precision = 0.043 usec (-24) 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: basedate set to 2022-02-04 2024-09-21T04:48:23.624 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: gps base set to 2022-02-06 (week 2196) 2024-09-21T04:48:23.625 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T04:48:23.625 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T04:48:23.625 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T04:48:23.625 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T04:48:23.626 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T04:48:23.626 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T04:48:23.626 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T04:48:23.626 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-09-21T04:48:23.627 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen normally on 4 lo [::1]:123 2024-09-21T04:48:23.627 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-09-21T04:48:23.627 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:23 ntpd[18490]: Listening on routing socket on fd #22 for interface updates 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:24.610 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:24 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:24.624 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.624 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.624 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:24.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:24.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:24.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:24 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:25 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:25.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:25 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:26.610 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:26 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:26.624 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:26.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:26 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:27.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:27.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:27 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:28.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:28 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:28.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:28 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:29.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:29.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:29.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:29.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:29.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:29.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:29 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:30.608 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stdout:21 Sep 04:48:30 ntpd[18465]: ntpd: time slew +0.000723 s 2024-09-21T04:48:30.609 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew +0.000723s 2024-09-21T04:48:30.610 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T04:48:30.610 INFO:teuthology.orchestra.run.smithi089.stderr:21 Sep 04:48:30 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.625 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T04:48:30.626 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T04:48:30.627 INFO:teuthology.orchestra.run.smithi110.stdout:21 Sep 04:48:30 ntpd[18490]: ntpd: time slew -0.000489 s 2024-09-21T04:48:30.627 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew -0.000489s 2024-09-21T04:48:30.627 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T04:48:30.627 INFO:teuthology.orchestra.run.smithi110.stderr:21 Sep 04:48:30 ntpd[18490]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T04:48:30.655 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T04:48:30.655 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-09-21T04:48:30.655 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.655 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.655 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.656 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T04:48:30.681 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T04:48:30.766 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_STRAY_DAEMON', 'CEPHADM_FAILED_DAEMON', 'CEPHADM_AGENT_DOWN'], 'log-only-match': ['CEPHADM_'], 'sha1': 'f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2'} 2024-09-21T04:48:30.766 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T04:48:30.767 INFO:tasks.cephadm:Cluster fsid is bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:48:30.767 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T04:48:30.767 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.89', 'mon.c': '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'mon.b': '172.21.15.110'} 2024-09-21T04:48:30.767 INFO:tasks.cephadm:First mon is mon.a on smithi089 2024-09-21T04:48:30.767 INFO:tasks.cephadm:First mgr is y 2024-09-21T04:48:30.767 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T04:48:30.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-21T04:48:30.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-09-21T04:48:30.795 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-21T04:48:30.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T04:48:30.937 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/83198/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5103-gf36283e7', 'node_name': '172.21.2.3+braggi03', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5103-gf36283e7-1jammy'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-20-2310/f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-21 00:58:01.351577', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-20-2310', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-20-2310/f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-21T04:48:31.138 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 4e45e6b490e6cbe082cdf155fea780438ec53fc7 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&ref=squid 2024-09-21T04:48:31.139 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-21T04:48:31.139 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-21T04:48:31.140 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:31.603 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791780 Sep 21 04:48 /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:31.603 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:32.065 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791780 Sep 21 04:48 /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:32.066 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:32.073 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T04:48:32.091 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-21T04:48:32.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T04:48:32.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T04:48:32.295 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T04:48:32.305 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T04:49:25.724 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-21T04:49:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T04:49:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T04:49:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-09-21T04:49:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T04:49:25.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-21T04:49:25.725 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T04:49:31.637 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T04:49:31.638 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T04:49:31.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-21T04:49:31.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-09-21T04:49:31.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-21T04:49:31.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-09-21T04:49:31.760 INFO:tasks.cephadm:Writing seed config... 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T04:49:31.761 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T04:49:31.762 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:49:31.762 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T04:49:31.790 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bfdfee20-77d4-11ef-baf5-efdc52797490 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T04:49:31.790 DEBUG:teuthology.orchestra.run.smithi089:mon.a> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T04:49:31.835 DEBUG:teuthology.orchestra.run.smithi089:mgr.y> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T04:49:31.879 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T04:49:31.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.89 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:49:32.102 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-21T04:49:32.102 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', 'bfdfee20-77d4-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.89', '--skip-admin-label'] 2024-09-21T04:49:32.102 INFO:teuthology.orchestra.run.smithi089.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T04:49:32.103 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying podman|docker is present... 2024-09-21T04:49:32.103 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying lvm2 is present... 2024-09-21T04:49:32.103 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying time synchronization is in place... 2024-09-21T04:49:32.108 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T04:49:32.108 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T04:49:32.113 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T04:49:32.114 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.119 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-21T04:49:32.119 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-21T04:49:32.123 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-21T04:49:32.123 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.126 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-21T04:49:32.126 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout masked 2024-09-21T04:49:32.130 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-21T04:49:32.130 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.133 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-21T04:49:32.134 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-21T04:49:32.137 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-21T04:49:32.137 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.140 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-21T04:49:32.144 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-21T04:49:32.144 INFO:teuthology.orchestra.run.smithi089.stdout:Unit ntp.service is enabled and running 2024-09-21T04:49:32.144 INFO:teuthology.orchestra.run.smithi089.stdout:Repeating the final host check... 2024-09-21T04:49:32.144 INFO:teuthology.orchestra.run.smithi089.stdout:docker (/usr/bin/docker) is present 2024-09-21T04:49:32.145 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl is present 2024-09-21T04:49:32.145 INFO:teuthology.orchestra.run.smithi089.stdout:lvcreate is present 2024-09-21T04:49:32.149 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T04:49:32.149 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T04:49:32.154 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T04:49:32.155 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-21T04:49:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-21T04:49:32.161 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-21T04:49:32.161 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.165 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-21T04:49:32.165 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout masked 2024-09-21T04:49:32.168 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-21T04:49:32.168 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.172 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-21T04:49:32.172 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-21T04:49:32.176 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-21T04:49:32.177 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-21T04:49:32.182 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-21T04:49:32.186 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-21T04:49:32.186 INFO:teuthology.orchestra.run.smithi089.stdout:Unit ntp.service is enabled and running 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Host looks OK 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Cluster fsid: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Acquiring lock 140696852282000 on /run/cephadm/bfdfee20-77d4-11ef-baf5-efdc52797490.lock 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Lock 140696852282000 acquired on /run/cephadm/bfdfee20-77d4-11ef-baf5-efdc52797490.lock 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 3300 ... 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 6789 ... 2024-09-21T04:49:32.187 INFO:teuthology.orchestra.run.smithi089.stdout:Base mon IP(s) is [172.21.15.89:3300, 172.21.15.89:6789], mon addrv is [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.89 metric 100 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.89 metric 100 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.89 metric 100 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.89 metric 100 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.89 metric 100 2024-09-21T04:49:32.190 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.89 metric 100 2024-09-21T04:49:32.192 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T04:49:32.192 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-09-21T04:49:32.192 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1786sec pref medium 2024-09-21T04:49:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T04:49:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T04:49:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T04:49:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T04:49:32.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.1/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.1/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.2/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.2/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.15.254/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.15.254/32` 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.0.1/32', '172.21.0.1/32', '172.21.0.2/32', '172.21.0.2/32', '172.21.15.254/32', '172.21.15.254/32'] 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T04:49:32.196 INFO:teuthology.orchestra.run.smithi089.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T04:49:32.434 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/docker: stdout squid: Pulling from ceph-ci/ceph 2024-09-21T04:49:32.434 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/docker: stdout Digest: sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64 2024-09-21T04:49:32.434 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T04:49:32.434 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/docker: stdout quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T04:49:34.068 INFO:teuthology.orchestra.run.smithi089.stdout:ceph: stdout ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T04:49:34.068 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph version: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T04:49:34.068 INFO:teuthology.orchestra.run.smithi089.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T04:49:35.548 INFO:teuthology.orchestra.run.smithi089.stdout:stat: stdout 167 167 2024-09-21T04:49:35.549 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial keys... 2024-09-21T04:49:37.013 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQBgUO5mxt5CGRAA+1O7a72n1SllctGjgk+XPA== 2024-09-21T04:49:38.444 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQBhUO5mfkHwNxAAPP8BloTZ40rqzdR6vAblWg== 2024-09-21T04:49:39.799 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQBjUO5mizrZEBAAI03+8sdnL5umkOu2887qIA== 2024-09-21T04:49:39.800 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial monmap... 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool for a [v2:172.21.15.89:3300,v1:172.21.15.89:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T04:49:41.357 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-09-21T04:49:41.358 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: set fsid to bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:41.358 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T04:49:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:49:41.358 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mon... 2024-09-21T04:49:42.772 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.226+0000 7f523dc63c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T04:49:42.772 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.226+0000 7f523dc63c80 1 imported monmap: 2024-09-21T04:49:42.772 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-21T04:49:42.772 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.226+0000 7f523dc63c80 0 /usr/bin/ceph-mon: set fsid to bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Git sha 0 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: DB SUMMARY 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.773 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: DB Session ID: GH1HCAKD0QVQL8MYGUXW 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.create_if_missing: 1 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.env: 0x56148148e940 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T04:49:42.774 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.info_log: 0x561483828bc0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.statistics: (nil) 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.use_fsync: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T04:49:42.775 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.db_log_dir: 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.wal_dir: 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.write_buffer_manager: 0x56148382f4a0 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T04:49:42.776 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.unordered_write: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.row_cache: None 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.wal_filter: None 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T04:49:42.777 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.wal_compression: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T04:49:42.778 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_open_files: -1 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T04:49:42.779 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Compression algorithms supported: 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kZSTD supported: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.230+0000 7f523dc63c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-21T04:49:42.780 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.merge_operator: 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_filter: None 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561483828800) 2024-09-21T04:49:42.781 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x5614838131f0 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-21T04:49:42.782 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-21T04:49:42.783 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression: NoCompression 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T04:49:42.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.num_levels: 7 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T04:49:42.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T04:49:42.786 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T04:49:42.787 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T04:49:42.788 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.ttl: 2592000 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T04:49:42.789 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.234+0000 7f523dc63c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7b12203a-1f6b-4340-aa46-326ca086f16b 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.790 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561483840e00 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: DB pointer 0x56148391a000 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f52353ee640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f52353ee640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:49:42.791 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T04:49:42.792 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x5614838131f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-21T04:49:42.238+0000 7f523dc63c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-21T04:49:42.793 INFO:teuthology.orchestra.run.smithi089.stdout:create mon.a on 2024-09-21T04:49:43.224 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-21T04:49:43.442 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target -> /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target. 2024-09-21T04:49:43.442 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target -> /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target. 2024-09-21T04:49:43.726 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a 2024-09-21T04:49:43.727 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T04:49:43.912 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target.wants/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service -> /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service. 2024-09-21T04:49:43.921 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld does not appear to be present 2024-09-21T04:49:43.921 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T04:49:43.921 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon to start... 2024-09-21T04:49:43.922 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon... 2024-09-21T04:49:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:43 smithi089 systemd[1]: Started Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:49:45.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:45 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405947+0000 mon.a (mon.0) 0 : cluster [INF] mkfs bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:45.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:45 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.395796+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T04:49:46.127 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T04:49:46.127 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout id: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:46.127 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout services: 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.168036s) 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout data: 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:mon is available 2024-09-21T04:49:46.128 INFO:teuthology.orchestra.run.smithi089.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.404861+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405049+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405063+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405076+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405089+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405103+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405116+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.405128+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.407805+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-21T04:49:46.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.410683+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-21T04:49:46.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: cluster 2024-09-21T04:49:45.411293+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-21T04:49:46.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:46 smithi089 bash[19345]: audit 2024-09-21T04:49:45.572842+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.89:0/2578076384' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T04:49:47.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:47 smithi089 bash[19345]: audit 2024-09-21T04:49:47.237580+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.89:0/1277008216' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T04:49:47.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:47 smithi089 bash[19345]: audit 2024-09-21T04:49:47.242633+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.89:0/1277008216' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T04:49:47.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:47.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T04:49:47.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:47.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-21T04:49:47.784 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T04:49:47.785 INFO:teuthology.orchestra.run.smithi089.stdout:Generating new minimal ceph.conf... 2024-09-21T04:49:49.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:48 smithi089 bash[19345]: audit 2024-09-21T04:49:48.865797+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.89:0/887548611' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:49:49.397 INFO:teuthology.orchestra.run.smithi089.stdout:Restarting the monitor... 2024-09-21T04:49:49.735 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:49 smithi089 systemd[1]: Stopping Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T04:49:49.735 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:49 smithi089 bash[19345]: debug 2024-09-21T04:49:49.518+0000 7f9337308640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T04:49:49.735 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:49 smithi089 bash[19345]: debug 2024-09-21T04:49:49.518+0000 7f9337308640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T04:49:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:49 smithi089 bash[19732]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-a 2024-09-21T04:49:50.145 INFO:teuthology.orchestra.run.smithi089.stdout:Setting public_network to 172.21.0.2/32,172.21.0.1/32,172.21.15.254/32,172.21.0.0/20 in mon config section 2024-09-21T04:49:50.476 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:50 smithi089 bash[19792]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-a 2024-09-21T04:49:50.477 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:50 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T04:49:50.477 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:50 smithi089 systemd[1]: Stopped Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:49:50.477 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:50 smithi089 systemd[1]: Started Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:49:51.778 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.682+0000 7f7adccdbc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.682+0000 7f7adccdbc80 0 ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 7 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.682+0000 7f7adccdbc80 0 pidfile_write: ignore empty --pid-file 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 0 load: jerasure load: lrc 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Git sha 0 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: DB SUMMARY 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: DB Session ID: 50R3NWSC7E0S1PCZ9V4F 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: CURRENT file: CURRENT 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-21T04:49:51.779 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88179 ; 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.create_if_missing: 0 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.env: 0x55a60e6bd940 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.info_log: 0x55a60ff096e0 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.statistics: (nil) 2024-09-21T04:49:51.780 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.use_fsync: 0 2024-09-21T04:49:51.781 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T04:49:51.781 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T04:49:51.781 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T04:49:51.781 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.db_log_dir: 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.wal_dir: 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T04:49:51.782 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.write_buffer_manager: 0x55a60ff18dc0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T04:49:51.783 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.unordered_write: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.row_cache: None 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.wal_filter: None 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.wal_compression: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T04:49:51.784 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T04:49:51.785 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_open_files: -1 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T04:49:51.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Compression algorithms supported: 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kZSTD supported: 0 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T04:49:51.787 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.merge_operator: 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_filter: None 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a60ff09320) 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cache_index_and_filter_blocks: 1 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T04:49:51.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: pin_top_level_index_and_filter: 1 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: index_type: 0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: data_block_index_type: 0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: index_shortening: 1 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: data_block_hash_table_util_ratio: 0.750000 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: checksum: 4 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: no_block_cache: 0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_cache: 0x55a60feff1f0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_cache_name: BinnedLRUCache 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_cache_options: 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: capacity : 536870912 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: num_shard_bits : 4 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: strict_capacity_limit : 0 2024-09-21T04:49:51.790 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: high_pri_pool_ratio: 0.000 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_cache_compressed: (nil) 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: persistent_cache: (nil) 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_size: 4096 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_size_deviation: 10 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_restart_interval: 16 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: index_block_restart_interval: 1 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: metadata_block_size: 4096 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: partition_filters: 0 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: use_delta_encoding: 1 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: filter_policy: bloomfilter 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: whole_key_filtering: 1 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: verify_compression: 0 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: read_amp_bytes_per_bit: 0 2024-09-21T04:49:51.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: format_version: 5 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: enable_index_compression: 1 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: block_align: 0 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: max_auto_readahead_size: 262144 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: prepopulate_block_cache: 0 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: initial_auto_readahead_size: 8192 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: num_file_reads_for_auto_readahead: 2 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression: NoCompression 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.num_levels: 7 2024-09-21T04:49:51.792 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T04:49:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T04:49:51.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T04:49:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T04:49:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.ttl: 2592000 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T04:49:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.686+0000 7f7adccdbc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7b12203a-1f6b-4340-aa46-326ca086f16b 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894191693943, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T04:49:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894191695403, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 84794, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 258, "table_properties": {"data_size": 82941, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10201, "raw_average_key_size": 47, "raw_value_size": 77150, "raw_average_value_size": 355, "num_data_blocks": 11, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726894191, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7b12203a-1f6b-4340-aa46-326ca086f16b", "db_session_id": "50R3NWSC7E0S1PCZ9V4F", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894191695545, "job": 1, "event": "recovery_finished"} 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a60ff2ae00 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7adccdbc80 4 rocksdb: DB pointer 0x55a61002a000 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7ad2aa4640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.690+0000 7f7ad2aa4640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: ** DB Stats ** 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T04:49:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: ** Compaction Stats [default] ** 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: L0 2/0 84.67 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Sum 2/0 84.67 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: ** Compaction Stats [default] ** 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 95.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:49:51.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: AddFile(Keys): cumulative 0, interval 0 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Cumulative compaction: 0.00 GB write, 16.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Interval compaction: 0.00 GB write, 16.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Block cache BinnedLRUCache@0x55a60feff1f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.1e-05 secs_since: 0 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: ** File Read Latency Histogram By Level [default] ** 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 1 mon.a@-1(???) e1 preinit fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).mds e1 new map 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).mds e1 print_map 2024-09-21T04:49:51.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: e1 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: btime 2024-09-21T04:49:45:405505+0000 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: legacy client fscid: -1 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: No filesystems configured 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: debug 2024-09-21T04:49:51.694+0000 7f7adccdbc80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722073+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722113+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-21T04:49:51.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722122+0000 mon.a (mon.0) 3 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722129+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722140+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722147+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722154+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722160+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722517+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722537+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-21T04:49:51.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:51 smithi089 bash[19831]: cluster 2024-09-21T04:49:51.722993+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-21T04:49:52.626 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T04:49:52.644 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:49:52.645 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mgr... 2024-09-21T04:49:52.645 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T04:49:52.645 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T04:49:52.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:49:52.990 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y 2024-09-21T04:49:52.990 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service: Unit ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service not loaded. 2024-09-21T04:49:53.195 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490.target.wants/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service -> /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service. 2024-09-21T04:49:53.204 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld does not appear to be present 2024-09-21T04:49:53.204 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T04:49:53.204 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld does not appear to be present 2024-09-21T04:49:53.204 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T04:49:53.205 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr to start... 2024-09-21T04:49:53.205 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr... 2024-09-21T04:49:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:53 smithi089 bash[19831]: audit 2024-09-21T04:49:52.031168+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.89:0/4091137133' entity='client.admin' 2024-09-21T04:49:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:53 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:49:53.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:53 smithi089 systemd[1]: Started Ceph mgr.y for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:49:54.978 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:54 smithi089 bash[20084]: debug 2024-09-21T04:49:54.882+0000 7fdc39f1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T04:49:55.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:55 smithi089 bash[19831]: audit 2024-09-21T04:49:54.967391+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.89:0/1806005245' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T04:49:55.502 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:55.502 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:49:55.502 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "bfdfee20-77d4-11ef-baf5-efdc52797490", 2024-09-21T04:49:55.502 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T04:49:55.503 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T04:49:55.504 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T04:49:45:405505+0000", 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.505 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T04:49:45.406488+0000", 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:49:55.506 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:55.507 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T04:49:55.507 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:49:55.507 INFO:teuthology.orchestra.run.smithi089.stdout:mgr not available, waiting (1/15)... 2024-09-21T04:49:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:56 smithi089 bash[20084]: debug 2024-09-21T04:49:56.074+0000 7fdc39f1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T04:49:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:56 smithi089 bash[20084]: debug 2024-09-21T04:49:56.138+0000 7fdc39f1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T04:49:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:56 smithi089 bash[20084]: debug 2024-09-21T04:49:56.286+0000 7fdc39f1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T04:49:57.259 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:56 smithi089 bash[20084]: debug 2024-09-21T04:49:56.934+0000 7fdc39f1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T04:49:57.259 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.002+0000 7fdc39f1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T04:49:57.259 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.070+0000 7fdc39f1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T04:49:57.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.254+0000 7fdc39f1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T04:49:57.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.330+0000 7fdc39f1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T04:49:57.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.398+0000 7fdc39f1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T04:49:57.919 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.654+0000 7fdc39f1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T04:49:57.919 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.718+0000 7fdc39f1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T04:49:58.247 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.914+0000 7fdc39f1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T04:49:58.247 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:57 smithi089 bash[20084]: debug 2024-09-21T04:49:57.990+0000 7fdc39f1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T04:49:58.501 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[20084]: debug 2024-09-21T04:49:58.242+0000 7fdc39f1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T04:49:58.501 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[20084]: debug 2024-09-21T04:49:58.418+0000 7fdc39f1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:49:58.788 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[20084]: debug 2024-09-21T04:49:58.590+0000 7fdc39f1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T04:49:58.789 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[20084]: debug 2024-09-21T04:49:58.682+0000 7fdc39f1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T04:49:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[19831]: audit 2024-09-21T04:49:58.777654+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.89:0/3277837981' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T04:49:59.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:58 smithi089 bash[20084]: debug 2024-09-21T04:49:58.866+0000 7fdc39f1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:49:59.313 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:49:59.313 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:49:59.313 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "bfdfee20-77d4-11ef-baf5-efdc52797490", 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:59.314 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T04:49:59.315 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T04:49:59.318 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.318 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T04:49:59.318 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T04:49:45:405505+0000", 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.319 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T04:49:45.406488+0000", 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:49:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:49:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T04:49:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:49:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:mgr not available, waiting (2/15)... 2024-09-21T04:49:59.977 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:59 smithi089 bash[20084]: debug 2024-09-21T04:49:59.674+0000 7fdc39f1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T04:49:59.977 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:59 smithi089 bash[20084]: debug 2024-09-21T04:49:59.750+0000 7fdc39f1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T04:50:00.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:49:59 smithi089 bash[20084]: debug 2024-09-21T04:49:59.970+0000 7fdc39f1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T04:50:00.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[20084]: debug 2024-09-21T04:50:00.046+0000 7fdc39f1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T04:50:00.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[20084]: debug 2024-09-21T04:50:00.430+0000 7fdc39f1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[20084]: debug 2024-09-21T04:50:00.510+0000 7fdc39f1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: cluster 2024-09-21T04:50:00.535963+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: cluster 2024-09-21T04:50:00.543606+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00784947s) 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.544587+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.544704+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.544794+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.544888+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.545786+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: cluster 2024-09-21T04:50:00.572072+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon y is now available 2024-09-21T04:50:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:00 smithi089 bash[19831]: audit 2024-09-21T04:50:00.584906+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T04:50:01.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:01 smithi089 bash[19831]: audit 2024-09-21T04:50:00.590347+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T04:50:01.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:01 smithi089 bash[19831]: audit 2024-09-21T04:50:00.592408+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' 2024-09-21T04:50:01.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:01 smithi089 bash[19831]: audit 2024-09-21T04:50:00.595178+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' 2024-09-21T04:50:01.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:01 smithi089 bash[19831]: audit 2024-09-21T04:50:00.597902+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.89:0/1895474579' entity='mgr.y' 2024-09-21T04:50:01.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:01 smithi089 bash[19831]: cluster 2024-09-21T04:50:01.549673+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: y(active, since 1.01391s) 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "bfdfee20-77d4-11ef-baf5-efdc52797490", 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T04:50:03.541 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T04:50:03.542 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T04:50:03.543 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T04:49:45:405505+0000", 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-21T04:50:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T04:49:45.406488+0000", 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T04:50:03.545 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-21T04:50:03.546 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T04:50:03.546 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:50:03.546 INFO:teuthology.orchestra.run.smithi089.stdout:mgr is available 2024-09-21T04:50:04.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:03 smithi089 bash[19831]: cluster 2024-09-21T04:50:02.596267+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-21T04:50:04.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:03 smithi089 bash[19831]: audit 2024-09-21T04:50:03.014726+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.89:0/2036886325' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T04:50:05.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:04 smithi089 bash[19831]: audit 2024-09-21T04:50:04.929348+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.89:0/2076616154' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T04:50:05.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:04 smithi089 bash[19831]: audit 2024-09-21T04:50:04.933131+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.89:0/2076616154' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T04:50:05.410 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T04:50:05.411 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T04:50:05.411 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T04:50:05.412 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling cephadm module... 2024-09-21T04:50:07.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:06 smithi089 bash[19831]: audit 2024-09-21T04:50:06.827730+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.89:0/4021874412' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T04:50:07.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:06 smithi089 bash[20084]: ignoring --setuser ceph since I am not root 2024-09-21T04:50:07.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:06 smithi089 bash[20084]: ignoring --setgroup ceph since I am not root 2024-09-21T04:50:07.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:07 smithi089 bash[20084]: debug 2024-09-21T04:50:07.030+0000 7faf213c0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T04:50:08.216 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:07 smithi089 bash[19831]: audit 2024-09-21T04:50:06.879515+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.89:0/4021874412' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T04:50:08.216 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:07 smithi089 bash[19831]: cluster 2024-09-21T04:50:06.885013+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 6s) 2024-09-21T04:50:08.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:08 smithi089 bash[20084]: debug 2024-09-21T04:50:08.210+0000 7faf213c0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T04:50:08.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:08 smithi089 bash[20084]: debug 2024-09-21T04:50:08.278+0000 7faf213c0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T04:50:08.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:08 smithi089 bash[20084]: debug 2024-09-21T04:50:08.434+0000 7faf213c0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T04:50:09.164 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.090+0000 7faf213c0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T04:50:09.164 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:08 smithi089 bash[19831]: audit 2024-09-21T04:50:08.838556+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.89:0/2750016217' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-21T04:50:09.357 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 5... 2024-09-21T04:50:09.422 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.158+0000 7faf213c0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T04:50:09.422 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.226+0000 7faf213c0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T04:50:09.422 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.418+0000 7faf213c0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T04:50:09.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.494+0000 7faf213c0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T04:50:09.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.562+0000 7faf213c0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T04:50:10.086 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.818+0000 7faf213c0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T04:50:10.086 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:09 smithi089 bash[20084]: debug 2024-09-21T04:50:09.886+0000 7faf213c0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T04:50:10.086 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.082+0000 7faf213c0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T04:50:10.341 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.158+0000 7faf213c0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T04:50:10.599 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.414+0000 7faf213c0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T04:50:10.599 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.594+0000 7faf213c0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:50:11.013 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.754+0000 7faf213c0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T04:50:11.014 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:10 smithi089 bash[20084]: debug 2024-09-21T04:50:10.830+0000 7faf213c0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T04:50:11.014 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:11 smithi089 bash[20084]: debug 2024-09-21T04:50:11.006+0000 7faf213c0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:50:12.112 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:11 smithi089 bash[20084]: debug 2024-09-21T04:50:11.810+0000 7faf213c0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T04:50:12.112 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:11 smithi089 bash[20084]: debug 2024-09-21T04:50:11.886+0000 7faf213c0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T04:50:12.112 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[20084]: debug 2024-09-21T04:50:12.106+0000 7faf213c0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T04:50:12.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[20084]: debug 2024-09-21T04:50:12.178+0000 7faf213c0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T04:50:13.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[20084]: debug 2024-09-21T04:50:12.562+0000 7faf213c0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T04:50:13.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[20084]: debug 2024-09-21T04:50:12.642+0000 7faf213c0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: cluster 2024-09-21T04:50:12.667775+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: cluster 2024-09-21T04:50:12.668326+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: cluster 2024-09-21T04:50:12.674999+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: cluster 2024-09-21T04:50:12.675139+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00699633s) 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: audit 2024-09-21T04:50:12.677621+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:50:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: audit 2024-09-21T04:50:12.679241+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T04:50:13.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: audit 2024-09-21T04:50:12.680390+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T04:50:13.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: audit 2024-09-21T04:50:12.680657+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T04:50:13.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: audit 2024-09-21T04:50:12.680880+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T04:50:13.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:12 smithi089 bash[19831]: cluster 2024-09-21T04:50:12.703633+0000 mon.a (mon.0) 46 : cluster [INF] Manager daemon y is now available 2024-09-21T04:50:13.726 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: cephadm 2024-09-21T04:50:12.715940+0000 mgr.y (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-21T04:50:13.726 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.721087+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.733225+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.736846+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.740264+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.749283+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T04:50:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:12.751469+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T04:50:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:13.291323+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: audit 2024-09-21T04:50:13.299206+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:13 smithi089 bash[19831]: cluster 2024-09-21T04:50:13.680722+0000 mon.a (mon.0) 55 : cluster [DBG] mgrmap e7: y(active, since 1.01258s) 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 5 is available 2024-09-21T04:50:14.306 INFO:teuthology.orchestra.run.smithi089.stdout:Setting orchestrator backend to cephadm... 2024-09-21T04:50:14.734 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: debug 2024-09-21T04:50:14.338+0000 7fae8df0a640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:04:50:14] ENGINE Error in HTTPServer.serve 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: Traceback (most recent call last): 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: self._connections.run(self.expiration_interval) 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: self._run(expiration_interval) 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: s = self.context.wrap_socket( 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T04:50:14.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: return self.sslsocket_class._create( 2024-09-21T04:50:14.736 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T04:50:14.736 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: self.do_handshake() 2024-09-21T04:50:14.736 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T04:50:14.736 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: self._sslobj.do_handshake() 2024-09-21T04:50:14.736 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[20084]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T04:50:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[19831]: audit 2024-09-21T04:50:13.680369+0000 mgr.y (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T04:50:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[19831]: audit 2024-09-21T04:50:13.693891+0000 mgr.y (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T04:50:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:14 smithi089 bash[19831]: audit 2024-09-21T04:50:14.441806+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cephadm 2024-09-21T04:50:14.219772+0000 mgr.y (mgr.14118) 4 : cephadm [INF] [21/Sep/2024:04:50:14] ENGINE Bus STARTING 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cephadm 2024-09-21T04:50:14.339405+0000 mgr.y (mgr.14118) 5 : cephadm [INF] [21/Sep/2024:04:50:14] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cephadm 2024-09-21T04:50:14.342412+0000 mgr.y (mgr.14118) 6 : cephadm [ERR] [21/Sep/2024:04:50:14] ENGINE Error in HTTPServer.serve 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T04:50:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: self.do_handshake() 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cephadm 2024-09-21T04:50:14.440540+0000 mgr.y (mgr.14118) 7 : cephadm [INF] [21/Sep/2024:04:50:14] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cephadm 2024-09-21T04:50:14.440671+0000 mgr.y (mgr.14118) 8 : cephadm [INF] [21/Sep/2024:04:50:14] ENGINE Bus STARTED 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: cluster 2024-09-21T04:50:14.732865+0000 mon.a (mon.0) 57 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: audit 2024-09-21T04:50:15.670590+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:15 smithi089 bash[19831]: audit 2024-09-21T04:50:15.689041+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:17.041 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:16 smithi089 bash[19831]: audit 2024-09-21T04:50:15.662539+0000 mgr.y (mgr.14118) 9 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:18.112 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T04:50:18.112 INFO:teuthology.orchestra.run.smithi089.stdout:Generating ssh key... 2024-09-21T04:50:18.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:17 smithi089 bash[19831]: audit 2024-09-21T04:50:17.563970+0000 mgr.y (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:20.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: Generating public/private rsa key pair. 2024-09-21T04:50:20.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: Your identification has been saved in /tmp/tmp1_iagcvk/key 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: Your public key has been saved in /tmp/tmp1_iagcvk/key.pub 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: The key fingerprint is: 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: SHA256:niMg+gXxoXx13tm/tJETdUd5DFC/XWP4VzpAfJRv0C0 ceph-bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: The key's randomart image is: 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: +---[RSA 3072]----+ 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | .o++=+| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | .. E+=| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | . . . . .o *O| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | . + o o . o .oo@| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | = + S o . ++o| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | . + . . . . +.| 2024-09-21T04:50:20.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: |. . . + * | 2024-09-21T04:50:20.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | . . . . . = | 2024-09-21T04:50:20.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: | . o | 2024-09-21T04:50:20.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:19 smithi089 bash[20084]: +----[SHA256]-----+ 2024-09-21T04:50:21.032 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:20 smithi089 bash[19831]: audit 2024-09-21T04:50:19.516273+0000 mgr.y (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:21.032 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:20 smithi089 bash[19831]: cephadm 2024-09-21T04:50:19.516600+0000 mgr.y (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-21T04:50:21.032 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:20 smithi089 bash[19831]: audit 2024-09-21T04:50:19.639288+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:21.032 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:20 smithi089 bash[19831]: audit 2024-09-21T04:50:19.643644+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:22.059 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZMr7EeP5t0SodkouvrMLdblbOX1BDPogxLAq3iti+LGNbl40qW9CLM6hLCmgReTS6aW4Gmejy5rfHElUrwpvu/1EmbPUe5OA//fSrFYyTOweJVEBp5L6wWqmTG5juWItVB/7u/7PxQT+mNOcjnx53+s1in8VtFShC/D6saKtekcpiOA4Bu07VQgigYZn0+rKDLxlcAXvIMXit9lxopX2qjazFbMc/FIWruI2i1oyTxLGmcB4GASxDb6w1lCDzMoyd1LbKu4FDSea1ql5VJcim4lQ1CCdkWMXDU6RzXX4gUObdgyvCbSy06snfUT1XaKK9yX0aZZIf/MhLo+xWGtiRHjoRKwaDR8xNahQRc2F6GC750LgNoJjaq1FqC6M7wRG0FiwwnqnAuHUnQa9MsxPvEU8koCNYdaxMqas7+NP8D2+NehRLHaooudEPJdvDfXL7xDPfSG2E+xfSU93Op4V2xPvKUZX9BL442GUNfmA1A3M5G2m3GqgPL1nIG0Q4mfs= ceph-bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:50:22.059 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:50:22.060 INFO:teuthology.orchestra.run.smithi089.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T04:50:22.060 INFO:teuthology.orchestra.run.smithi089.stdout:Adding host smithi089... 2024-09-21T04:50:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:21 smithi089 bash[19831]: audit 2024-09-21T04:50:21.507435+0000 mgr.y (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:24.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:23 smithi089 bash[19831]: audit 2024-09-21T04:50:23.507875+0000 mgr.y (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "addr": "172.21.15.89", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:25.112 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:24 smithi089 bash[19831]: cephadm 2024-09-21T04:50:24.471793+0000 mgr.y (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi089 2024-09-21T04:50:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Added host 'smithi089' with addr '172.21.15.89' 2024-09-21T04:50:28.224 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying unmanaged mon service... 2024-09-21T04:50:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:28 smithi089 bash[19831]: audit 2024-09-21T04:50:27.517808+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:28 smithi089 bash[19831]: cephadm 2024-09-21T04:50:27.518159+0000 mgr.y (mgr.14118) 16 : cephadm [INF] Added host smithi089 2024-09-21T04:50:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:28 smithi089 bash[19831]: audit 2024-09-21T04:50:27.518502+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:31.082 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T04:50:31.082 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying unmanaged mgr service... 2024-09-21T04:50:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:31 smithi089 bash[19831]: audit 2024-09-21T04:50:30.302988+0000 mgr.y (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:31 smithi089 bash[19831]: cephadm 2024-09-21T04:50:30.305576+0000 mgr.y (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-21T04:50:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:31 smithi089 bash[19831]: audit 2024-09-21T04:50:30.308921+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:31 smithi089 bash[19831]: audit 2024-09-21T04:50:31.102440+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:32 smithi089 bash[19831]: audit 2024-09-21T04:50:31.633424+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:32 smithi089 bash[19831]: audit 2024-09-21T04:50:32.614416+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:33.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T04:50:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:33 smithi089 bash[19831]: audit 2024-09-21T04:50:32.607805+0000 mgr.y (mgr.14118) 19 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:33 smithi089 bash[19831]: cephadm 2024-09-21T04:50:32.610045+0000 mgr.y (mgr.14118) 20 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-21T04:50:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:33 smithi089 bash[19831]: cluster 2024-09-21T04:50:32.681980+0000 mgr.y (mgr.14118) 21 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:50:35.904 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:35 smithi089 bash[19831]: audit 2024-09-21T04:50:34.568417+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.89:0/1193273143' entity='client.admin' 2024-09-21T04:50:35.904 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:35 smithi089 bash[19831]: cluster 2024-09-21T04:50:34.682203+0000 mgr.y (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:50:37.003 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling the dashboard module... 2024-09-21T04:50:37.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:37 smithi089 bash[19831]: audit 2024-09-21T04:50:36.419157+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.89:0/1421368662' entity='client.admin' 2024-09-21T04:50:37.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:37 smithi089 bash[19831]: cluster 2024-09-21T04:50:36.682616+0000 mgr.y (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:50:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:38 smithi089 bash[19831]: audit 2024-09-21T04:50:37.673175+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14118 172.21.15.89:0/3809081826' entity='mgr.y' 2024-09-21T04:50:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:38 smithi089 bash[19831]: audit 2024-09-21T04:50:38.468365+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.89:0/1479330712' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T04:50:39.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:38 smithi089 bash[20084]: ignoring --setuser ceph since I am not root 2024-09-21T04:50:39.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:38 smithi089 bash[20084]: ignoring --setgroup ceph since I am not root 2024-09-21T04:50:39.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:38 smithi089 bash[20084]: debug 2024-09-21T04:50:38.838+0000 7fcda2806040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T04:50:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:39 smithi089 bash[19831]: audit 2024-09-21T04:50:38.678471+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.89:0/1479330712' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T04:50:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:39 smithi089 bash[19831]: cluster 2024-09-21T04:50:38.682229+0000 mon.a (mon.0) 73 : cluster [DBG] mgrmap e9: y(active, since 26s) 2024-09-21T04:50:40.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[20084]: debug 2024-09-21T04:50:40.018+0000 7fcda2806040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T04:50:40.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[20084]: debug 2024-09-21T04:50:40.082+0000 7fcda2806040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T04:50:40.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[20084]: debug 2024-09-21T04:50:40.242+0000 7fcda2806040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T04:50:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[19831]: audit 2024-09-21T04:50:40.734829+0000 mon.a (mon.0) 74 : audit [DBG] from='client.? 172.21.15.89:0/356884225' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T04:50:41.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[20084]: debug 2024-09-21T04:50:40.902+0000 7fcda2806040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T04:50:41.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:40 smithi089 bash[20084]: debug 2024-09-21T04:50:40.974+0000 7fcda2806040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T04:50:41.276 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:50:41.277 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-21T04:50:41.277 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 9... 2024-09-21T04:50:41.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.042+0000 7fcda2806040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T04:50:41.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.226+0000 7fcda2806040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T04:50:41.632 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.306+0000 7fcda2806040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T04:50:41.632 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.374+0000 7fcda2806040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T04:50:41.895 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.626+0000 7fcda2806040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T04:50:41.895 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.694+0000 7fcda2806040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T04:50:42.222 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.890+0000 7fcda2806040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T04:50:42.222 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:41 smithi089 bash[20084]: debug 2024-09-21T04:50:41.966+0000 7fcda2806040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T04:50:42.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:42 smithi089 bash[20084]: debug 2024-09-21T04:50:42.218+0000 7fcda2806040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T04:50:42.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:42 smithi089 bash[20084]: debug 2024-09-21T04:50:42.402+0000 7fcda2806040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:50:42.825 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:42 smithi089 bash[20084]: debug 2024-09-21T04:50:42.566+0000 7fcda2806040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T04:50:42.825 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:42 smithi089 bash[20084]: debug 2024-09-21T04:50:42.642+0000 7fcda2806040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T04:50:43.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:42 smithi089 bash[20084]: debug 2024-09-21T04:50:42.818+0000 7fcda2806040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:50:43.929 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:43 smithi089 bash[20084]: debug 2024-09-21T04:50:43.626+0000 7fcda2806040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T04:50:43.929 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:43 smithi089 bash[20084]: debug 2024-09-21T04:50:43.702+0000 7fcda2806040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T04:50:44.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:43 smithi089 bash[20084]: debug 2024-09-21T04:50:43.922+0000 7fcda2806040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T04:50:44.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[20084]: debug 2024-09-21T04:50:43.998+0000 7fcda2806040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T04:50:44.661 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[20084]: debug 2024-09-21T04:50:44.382+0000 7fcda2806040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T04:50:44.661 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[20084]: debug 2024-09-21T04:50:44.458+0000 7fcda2806040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T04:50:44.661 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: cluster 2024-09-21T04:50:44.483763+0000 mon.a (mon.0) 75 : cluster [INF] Active manager daemon y restarted 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: cluster 2024-09-21T04:50:44.484214+0000 mon.a (mon.0) 76 : cluster [INF] Activating manager daemon y 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: cluster 2024-09-21T04:50:44.491730+0000 mon.a (mon.0) 77 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: cluster 2024-09-21T04:50:44.492099+0000 mon.a (mon.0) 78 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00806016s) 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: audit 2024-09-21T04:50:44.493529+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: audit 2024-09-21T04:50:44.495396+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: audit 2024-09-21T04:50:44.496122+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: audit 2024-09-21T04:50:44.496231+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: audit 2024-09-21T04:50:44.496348+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T04:50:44.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:44 smithi089 bash[19831]: cluster 2024-09-21T04:50:44.519708+0000 mon.a (mon.0) 84 : cluster [INF] Manager daemon y is now available 2024-09-21T04:50:45.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[19831]: audit 2024-09-21T04:50:44.538877+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:50:45.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[19831]: audit 2024-09-21T04:50:44.554496+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T04:50:45.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[19831]: audit 2024-09-21T04:50:44.556686+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T04:50:45.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[19831]: cluster 2024-09-21T04:50:45.496432+0000 mon.a (mon.0) 88 : cluster [DBG] mgrmap e11: y(active, since 1.01239s) 2024-09-21T04:50:46.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-21T04:50:46.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T04:50:46.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T04:50:46.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-21T04:50:46.201 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 9 is available 2024-09-21T04:50:46.201 INFO:teuthology.orchestra.run.smithi089.stdout:Generating a dashboard self-signed certificate... 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: debug 2024-09-21T04:50:45.854+0000 7fcd0db0d640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:04:50:45] ENGINE Error in HTTPServer.serve 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: Traceback (most recent call last): 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: self._connections.run(self.expiration_interval) 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: self._run(expiration_interval) 2024-09-21T04:50:46.283 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: s = self.context.wrap_socket( 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: return self.sslsocket_class._create( 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: self.do_handshake() 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: self._sslobj.do_handshake() 2024-09-21T04:50:46.284 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:50:45 smithi089 bash[20084]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T04:50:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:46 smithi089 bash[19831]: cephadm 2024-09-21T04:50:45.733907+0000 mgr.y (mgr.14150) 3 : cephadm [INF] [21/Sep/2024:04:50:45] ENGINE Bus STARTING 2024-09-21T04:50:47.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: cephadm 2024-09-21T04:50:45.854400+0000 mgr.y (mgr.14150) 4 : cephadm [INF] [21/Sep/2024:04:50:45] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T04:50:47.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: cephadm 2024-09-21T04:50:45.857854+0000 mgr.y (mgr.14150) 5 : cephadm [ERR] [21/Sep/2024:04:50:45] ENGINE Error in HTTPServer.serve 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T04:50:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: self.do_handshake() 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: cephadm 2024-09-21T04:50:45.955431+0000 mgr.y (mgr.14150) 6 : cephadm [INF] [21/Sep/2024:04:50:45] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: cephadm 2024-09-21T04:50:45.955533+0000 mgr.y (mgr.14150) 7 : cephadm [INF] [21/Sep/2024:04:50:45] ENGINE Bus STARTED 2024-09-21T04:50:47.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:47 smithi089 bash[19831]: cluster 2024-09-21T04:50:46.552660+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-09-21T04:50:48.341 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T04:50:48.341 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial admin user... 2024-09-21T04:50:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:48 smithi089 bash[19831]: audit 2024-09-21T04:50:47.671619+0000 mgr.y (mgr.14150) 8 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:48 smithi089 bash[19831]: audit 2024-09-21T04:50:47.762762+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:50:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:48 smithi089 bash[19831]: audit 2024-09-21T04:50:47.764819+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:50:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$q.uw3BI52vTgnfkphgXlPeCxPKo/RmLilTgEjXLp1btsyKVSGfjFO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726894250, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T04:50:50.538 INFO:teuthology.orchestra.run.smithi089.stdout:Fetching dashboard port number... 2024-09-21T04:50:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:51 smithi089 bash[19831]: audit 2024-09-21T04:50:49.744830+0000 mgr.y (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:50:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:51 smithi089 bash[19831]: audit 2024-09-21T04:50:50.011913+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:50:51.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:51 smithi089 bash[19831]: audit 2024-09-21T04:50:50.049578+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:50:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:52 smithi089 bash[19831]: cluster 2024-09-21T04:50:51.054836+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-09-21T04:50:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:52 smithi089 bash[19831]: audit 2024-09-21T04:50:51.086065+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:50:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:52 smithi089 bash[19831]: audit 2024-09-21T04:50:51.897777+0000 mon.a (mon.0) 96 : audit [DBG] from='client.? 172.21.15.89:0/536197326' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T04:50:52.456 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T04:50:52.456 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld does not appear to be present 2024-09-21T04:50:52.456 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph Dashboard is now available at: 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: URL: https://smithi089.front.sepia.ceph.com:8443/ 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: User: admin 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: Password: 4cr4svmeyj 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:52.459 INFO:teuthology.orchestra.run.smithi089.stdout:Saving cluster configuration to /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config directory 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T04:50:54.530 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: ceph telemetry on 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout:For more information see: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:50:54.531 INFO:teuthology.orchestra.run.smithi089.stdout:Bootstrap complete. 2024-09-21T04:50:54.578 INFO:tasks.cephadm:Fetching config... 2024-09-21T04:50:54.579 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:50:54.579 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T04:50:54.584 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T04:50:54.584 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:50:54.584 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T04:50:54.633 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T04:50:54.633 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:50:54.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T04:50:54.689 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T04:50:54.689 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:50:54.689 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T04:50:54.737 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T04:50:54.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZMr7EeP5t0SodkouvrMLdblbOX1BDPogxLAq3iti+LGNbl40qW9CLM6hLCmgReTS6aW4Gmejy5rfHElUrwpvu/1EmbPUe5OA//fSrFYyTOweJVEBp5L6wWqmTG5juWItVB/7u/7PxQT+mNOcjnx53+s1in8VtFShC/D6saKtekcpiOA4Bu07VQgigYZn0+rKDLxlcAXvIMXit9lxopX2qjazFbMc/FIWruI2i1oyTxLGmcB4GASxDb6w1lCDzMoyd1LbKu4FDSea1ql5VJcim4lQ1CCdkWMXDU6RzXX4gUObdgyvCbSy06snfUT1XaKK9yX0aZZIf/MhLo+xWGtiRHjoRKwaDR8xNahQRc2F6GC750LgNoJjaq1FqC6M7wRG0FiwwnqnAuHUnQa9MsxPvEU8koCNYdaxMqas7+NP8D2+NehRLHaooudEPJdvDfXL7xDPfSG2E+xfSU93Op4V2xPvKUZX9BL442GUNfmA1A3M5G2m3GqgPL1nIG0Q4mfs= ceph-bfdfee20-77d4-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T04:50:54.801 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZMr7EeP5t0SodkouvrMLdblbOX1BDPogxLAq3iti+LGNbl40qW9CLM6hLCmgReTS6aW4Gmejy5rfHElUrwpvu/1EmbPUe5OA//fSrFYyTOweJVEBp5L6wWqmTG5juWItVB/7u/7PxQT+mNOcjnx53+s1in8VtFShC/D6saKtekcpiOA4Bu07VQgigYZn0+rKDLxlcAXvIMXit9lxopX2qjazFbMc/FIWruI2i1oyTxLGmcB4GASxDb6w1lCDzMoyd1LbKu4FDSea1ql5VJcim4lQ1CCdkWMXDU6RzXX4gUObdgyvCbSy06snfUT1XaKK9yX0aZZIf/MhLo+xWGtiRHjoRKwaDR8xNahQRc2F6GC750LgNoJjaq1FqC6M7wRG0FiwwnqnAuHUnQa9MsxPvEU8koCNYdaxMqas7+NP8D2+NehRLHaooudEPJdvDfXL7xDPfSG2E+xfSU93Op4V2xPvKUZX9BL442GUNfmA1A3M5G2m3GqgPL1nIG0Q4mfs= ceph-bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:50:54.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZMr7EeP5t0SodkouvrMLdblbOX1BDPogxLAq3iti+LGNbl40qW9CLM6hLCmgReTS6aW4Gmejy5rfHElUrwpvu/1EmbPUe5OA//fSrFYyTOweJVEBp5L6wWqmTG5juWItVB/7u/7PxQT+mNOcjnx53+s1in8VtFShC/D6saKtekcpiOA4Bu07VQgigYZn0+rKDLxlcAXvIMXit9lxopX2qjazFbMc/FIWruI2i1oyTxLGmcB4GASxDb6w1lCDzMoyd1LbKu4FDSea1ql5VJcim4lQ1CCdkWMXDU6RzXX4gUObdgyvCbSy06snfUT1XaKK9yX0aZZIf/MhLo+xWGtiRHjoRKwaDR8xNahQRc2F6GC750LgNoJjaq1FqC6M7wRG0FiwwnqnAuHUnQa9MsxPvEU8koCNYdaxMqas7+NP8D2+NehRLHaooudEPJdvDfXL7xDPfSG2E+xfSU93Op4V2xPvKUZX9BL442GUNfmA1A3M5G2m3GqgPL1nIG0Q4mfs= ceph-bfdfee20-77d4-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T04:50:54.832 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZMr7EeP5t0SodkouvrMLdblbOX1BDPogxLAq3iti+LGNbl40qW9CLM6hLCmgReTS6aW4Gmejy5rfHElUrwpvu/1EmbPUe5OA//fSrFYyTOweJVEBp5L6wWqmTG5juWItVB/7u/7PxQT+mNOcjnx53+s1in8VtFShC/D6saKtekcpiOA4Bu07VQgigYZn0+rKDLxlcAXvIMXit9lxopX2qjazFbMc/FIWruI2i1oyTxLGmcB4GASxDb6w1lCDzMoyd1LbKu4FDSea1ql5VJcim4lQ1CCdkWMXDU6RzXX4gUObdgyvCbSy06snfUT1XaKK9yX0aZZIf/MhLo+xWGtiRHjoRKwaDR8xNahQRc2F6GC750LgNoJjaq1FqC6M7wRG0FiwwnqnAuHUnQa9MsxPvEU8koCNYdaxMqas7+NP8D2+NehRLHaooudEPJdvDfXL7xDPfSG2E+xfSU93Op4V2xPvKUZX9BL442GUNfmA1A3M5G2m3GqgPL1nIG0Q4mfs= ceph-bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:50:54.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T04:50:55.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:50:54 smithi089 bash[19831]: audit 2024-09-21T04:50:53.953537+0000 mon.a (mon.0) 97 : audit [INF] from='client.? 172.21.15.89:0/478877163' entity='client.admin' 2024-09-21T04:50:59.650 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:51:01.873 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T04:51:01.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T04:51:02.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:02 smithi089 bash[19831]: audit 2024-09-21T04:51:01.121852+0000 mon.a (mon.0) 98 : audit [INF] from='client.? 172.21.15.89:0/692367005' entity='client.admin' 2024-09-21T04:51:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.181496+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.186799+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.188371+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:51:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.194771+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.222028+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:03 smithi089 bash[19831]: audit 2024-09-21T04:51:02.229153+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:05.595 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:51:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:05 smithi089 bash[19831]: cluster 2024-09-21T04:51:04.497890+0000 mgr.y (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:07.575 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi110 2024-09-21T04:51:07.575 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:51:07.575 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.conf 2024-09-21T04:51:07.581 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:51:07.581 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:51:07.628 INFO:tasks.cephadm:Adding host smithi110 to orchestrator... 2024-09-21T04:51:07.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch host add smithi110 2024-09-21T04:51:08.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: cluster 2024-09-21T04:51:06.498289+0000 mgr.y (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:08.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:06.922386+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:08.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:06.923555+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:08.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:06.926502+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:06.927394+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:07.309027+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:07.314513+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:07 smithi089 bash[19831]: audit 2024-09-21T04:51:07.319313+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:08 smithi089 bash[19831]: audit 2024-09-21T04:51:06.918594+0000 mgr.y (mgr.14150) 12 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:08 smithi089 bash[19831]: cephadm 2024-09-21T04:51:06.928585+0000 mgr.y (mgr.14150) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T04:51:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:08 smithi089 bash[19831]: cephadm 2024-09-21T04:51:07.020506+0000 mgr.y (mgr.14150) 14 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:08 smithi089 bash[19831]: cephadm 2024-09-21T04:51:07.103985+0000 mgr.y (mgr.14150) 15 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:51:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:08 smithi089 bash[19831]: cephadm 2024-09-21T04:51:07.202139+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T04:51:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:09 smithi089 bash[19831]: cluster 2024-09-21T04:51:08.498820+0000 mgr.y (mgr.14150) 17 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:11 smithi089 bash[19831]: cluster 2024-09-21T04:51:10.499236+0000 mgr.y (mgr.14150) 18 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:12.353 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:51:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:13 smithi089 bash[19831]: cluster 2024-09-21T04:51:12.499662+0000 mgr.y (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:14 smithi089 bash[19831]: audit 2024-09-21T04:51:13.634475+0000 mgr.y (mgr.14150) 20 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:16.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:15 smithi089 bash[19831]: cluster 2024-09-21T04:51:14.500031+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:16.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:15 smithi089 bash[19831]: cephadm 2024-09-21T04:51:14.665421+0000 mgr.y (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi110 2024-09-21T04:51:17.831 INFO:teuthology.orchestra.run.smithi089.stdout:Added host 'smithi110' with addr '172.21.15.110' 2024-09-21T04:51:17.848 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:17 smithi089 bash[19831]: cluster 2024-09-21T04:51:16.500409+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:18.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T04:51:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:18 smithi089 bash[19831]: audit 2024-09-21T04:51:17.830562+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:18 smithi089 bash[19831]: cephadm 2024-09-21T04:51:17.831382+0000 mgr.y (mgr.14150) 24 : cephadm [INF] Added host smithi110 2024-09-21T04:51:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:18 smithi089 bash[19831]: audit 2024-09-21T04:51:17.832129+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:18 smithi089 bash[19831]: audit 2024-09-21T04:51:18.365029+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:18 smithi089 bash[19831]: cluster 2024-09-21T04:51:18.500844+0000 mgr.y (mgr.14150) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:21.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:20 smithi089 bash[19831]: audit 2024-09-21T04:51:19.926600+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:21.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:20 smithi089 bash[19831]: cluster 2024-09-21T04:51:20.501233+0000 mgr.y (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:22.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:22 smithi089 bash[19831]: audit 2024-09-21T04:51:21.243235+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:23.185 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:51:23.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:23 smithi089 bash[19831]: cluster 2024-09-21T04:51:22.501678+0000 mgr.y (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:24.512 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:51:24.513 INFO:teuthology.orchestra.run.smithi089.stdout:[{"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}, {"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}] 2024-09-21T04:51:25.111 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T04:51:25.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T04:51:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:25 smithi089 bash[19831]: cluster 2024-09-21T04:51:24.502051+0000 mgr.y (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:25 smithi089 bash[19831]: audit 2024-09-21T04:51:24.513030+0000 mgr.y (mgr.14150) 29 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:51:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: cluster 2024-09-21T04:51:26.502550+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.806343+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.811701+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.817889+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.822988+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.824763+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.826710+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:26.828509+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:27.427904+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:27.431662+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:27 smithi089 bash[19831]: audit 2024-09-21T04:51:27.437747+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:28 smithi089 bash[19831]: cephadm 2024-09-21T04:51:26.830971+0000 mgr.y (mgr.14150) 31 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T04:51:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:28 smithi089 bash[19831]: cephadm 2024-09-21T04:51:27.007729+0000 mgr.y (mgr.14150) 32 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:28 smithi089 bash[19831]: cephadm 2024-09-21T04:51:27.155694+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:51:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:28 smithi089 bash[19831]: cephadm 2024-09-21T04:51:27.290673+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T04:51:29.836 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:51:29.919 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:29 smithi089 bash[19831]: cluster 2024-09-21T04:51:28.503036+0000 mgr.y (mgr.14150) 35 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-09-21T04:51:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:31 smithi089 bash[19831]: cluster 2024-09-21T04:51:30.503468+0000 mgr.y (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:31 smithi089 bash[19831]: audit 2024-09-21T04:51:31.163720+0000 mon.a (mon.0) 127 : audit [INF] from='client.? 172.21.15.89:0/991011030' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T04:51:32.160 INFO:tasks.cephadm:Adding mon.a on smithi089 2024-09-21T04:51:32.160 INFO:tasks.cephadm:Adding mon.c on smithi089 2024-09-21T04:51:32.160 INFO:tasks.cephadm:Adding mon.b on smithi110 2024-09-21T04:51:32.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b' 2024-09-21T04:51:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:32 smithi089 bash[19831]: audit 2024-09-21T04:51:31.568820+0000 mon.a (mon.0) 128 : audit [INF] from='client.? 172.21.15.89:0/991011030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T04:51:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:32 smithi089 bash[19831]: cluster 2024-09-21T04:51:31.572700+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:33.383 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:34.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:33 smithi089 bash[19831]: cluster 2024-09-21T04:51:32.503890+0000 mgr.y (mgr.14150) 37 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:34.688 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled mon update... 2024-09-21T04:51:35.222 DEBUG:teuthology.orchestra.run.smithi089:mon.c> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T04:51:35.224 DEBUG:teuthology.orchestra.run.smithi110:mon.b> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T04:51:35.226 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T04:51:35.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T04:51:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: cluster 2024-09-21T04:51:34.504308+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.678166+0000 mgr.y (mgr.14150) 39 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: cephadm 2024-09-21T04:51:34.683387+0000 mgr.y (mgr.14150) 40 : cephadm [INF] Saving service mon spec with placement smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b;count:3 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.688189+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.689676+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.693011+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.694672+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.704351+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.708113+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: audit 2024-09-21T04:51:34.709815+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:35 smithi089 bash[19831]: cephadm 2024-09-21T04:51:34.711911+0000 mgr.y (mgr.14150) 41 : cephadm [INF] Deploying daemon mon.b on smithi110 2024-09-21T04:51:36.481 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:37 smithi089 bash[19831]: cluster 2024-09-21T04:51:36.504759+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:38.460 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 1 2024-09-21T04:51:38.460 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:51:38.460 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","modified":"2024-09-21T04:49:40.825749Z","created":"2024-09-21T04:49:40.825749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T04:51:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:38 smithi089 bash[19831]: audit 2024-09-21T04:51:38.460942+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.110:0/413032441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:39 smithi089 bash[19831]: cluster 2024-09-21T04:51:38.505191+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:40.298 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T04:51:40.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T04:51:41.504 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: audit 2024-09-21T04:51:40.448721+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: audit 2024-09-21T04:51:40.454544+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: audit 2024-09-21T04:51:40.460593+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: audit 2024-09-21T04:51:40.461940+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: audit 2024-09-21T04:51:40.463640+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: cephadm 2024-09-21T04:51:40.465576+0000 mgr.y (mgr.14150) 44 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T04:51:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:41 smithi089 bash[19831]: cluster 2024-09-21T04:51:40.505692+0000 mgr.y (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:41.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:41 smithi110 bash[22020]: debug 2024-09-21T04:51:41.532+0000 7efc68f3f640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T04:51:44.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:51:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:51:44.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:51:44.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:51:44.924 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:51:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:51:44.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:44 smithi089 systemd[1]: Started Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 0 ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 7 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 0 pidfile_write: ignore empty --pid-file 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 0 load: jerasure load: lrc 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Git sha 0 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: DB SUMMARY 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: DB Session ID: X2IUHQ9NBQCN95C9BT3Y 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: CURRENT file: CURRENT 2024-09-21T04:51:46.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.create_if_missing: 0 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.env: 0x55824c8f7940 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T04:51:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.info_log: 0x55824deed6e0 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.statistics: (nil) 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.use_fsync: 0 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T04:51:46.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.db_log_dir: 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.wal_dir: 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T04:51:46.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.write_buffer_manager: 0x55824defcdc0 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T04:51:46.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.unordered_write: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.row_cache: None 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.wal_filter: None 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.wal_compression: 0 2024-09-21T04:51:46.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T04:51:46.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_open_files: -1 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T04:51:46.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Compression algorithms supported: 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kZSTD supported: 0 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T04:51:46.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.merge_operator: 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_filter: None 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55824deed320) 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cache_index_and_filter_blocks: 1 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: pin_top_level_index_and_filter: 1 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: index_type: 0 2024-09-21T04:51:46.307 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: data_block_index_type: 0 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: index_shortening: 1 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: data_block_hash_table_util_ratio: 0.750000 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: checksum: 4 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: no_block_cache: 0 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_cache: 0x55824dee31f0 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_cache_name: BinnedLRUCache 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_cache_options: 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: capacity : 536870912 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: num_shard_bits : 4 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: strict_capacity_limit : 0 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: high_pri_pool_ratio: 0.000 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_cache_compressed: (nil) 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: persistent_cache: (nil) 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_size: 4096 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_size_deviation: 10 2024-09-21T04:51:46.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_restart_interval: 16 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: index_block_restart_interval: 1 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: metadata_block_size: 4096 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: partition_filters: 0 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: use_delta_encoding: 1 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: filter_policy: bloomfilter 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: whole_key_filtering: 1 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: verify_compression: 0 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: read_amp_bytes_per_bit: 0 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: format_version: 5 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: enable_index_compression: 1 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: block_align: 0 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: max_auto_readahead_size: 262144 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: prepopulate_block_cache: 0 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: initial_auto_readahead_size: 8192 2024-09-21T04:51:46.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: num_file_reads_for_auto_readahead: 2 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression: NoCompression 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.num_levels: 7 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T04:51:46.310 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T04:51:46.311 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T04:51:46.312 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T04:51:46.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T04:51:46.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.ttl: 2592000 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T04:51:46.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5ea2208a-ab81-4b55-ae7f-e725bc12c962 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894305959664, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894305960299, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726894305, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5ea2208a-ab81-4b55-ae7f-e725bc12c962", "db_session_id": "X2IUHQ9NBQCN95C9BT3Y", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726894305960466, "job": 1, "event": "recovery_finished"} 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.953+0000 7f16f5b29c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T04:51:46.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55824df0ee00 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 4 rocksdb: DB pointer 0x55824e00e000 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16eb8f2640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16eb8f2640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: ** DB Stats ** 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: ** Compaction Stats [default] ** 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:51:46.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: ** Compaction Stats [default] ** 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: AddFile(Keys): cumulative 0, interval 0 2024-09-21T04:51:46.318 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Cumulative compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Interval compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Block cache BinnedLRUCache@0x55824dee31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: ** File Read Latency Histogram By Level [default] ** 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 0 using public_addrv [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.957+0000 7f16f5b29c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] at bind addrs [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.961+0000 7f16f5b29c80 1 mon.c@-1(???) e0 preinit fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: e1 2024-09-21T04:51:46.319 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: btime 2024-09-21T04:49:45:405505+0000 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: legacy client fscid: -1 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: No filesystems configured 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:51:46.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:13.634475+0000 mgr.y (mgr.14150) 20 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:14.500031+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:14.665421+0000 mgr.y (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi110 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:16.500409+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:17.830562+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:17.831382+0000 mgr.y (mgr.14150) 24 : cephadm [INF] Added host smithi110 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:17.832129+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:18.365029+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:18.500844+0000 mgr.y (mgr.14150) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:19.926600+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:20.501233+0000 mgr.y (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:21.243235+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:22.501678+0000 mgr.y (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:24.502051+0000 mgr.y (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:24.513030+0000 mgr.y (mgr.14150) 29 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:26.502550+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.806343+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.811701+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.817889+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.822988+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.824763+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.826710+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:26.828509+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:27.427904+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:27.431662+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:27.437747+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.322 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:26.830971+0000 mgr.y (mgr.14150) 31 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:27.007729+0000 mgr.y (mgr.14150) 32 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:27.155694+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:27.290673+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:28.503036+0000 mgr.y (mgr.14150) 35 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:30.503468+0000 mgr.y (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:31.163720+0000 mon.a (mon.0) 127 : audit [INF] from='client.? 172.21.15.89:0/991011030' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:31.568820+0000 mon.a (mon.0) 128 : audit [INF] from='client.? 172.21.15.89:0/991011030' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:31.572700+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:32.503890+0000 mgr.y (mgr.14150) 37 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:34.504308+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.678166+0000 mgr.y (mgr.14150) 39 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:34.683387+0000 mgr.y (mgr.14150) 40 : cephadm [INF] Saving service mon spec with placement smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b;count:3 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.688189+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.323 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.689676+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.693011+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.694672+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.704351+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.708113+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:34.709815+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:34.711911+0000 mgr.y (mgr.14150) 41 : cephadm [INF] Deploying daemon mon.b on smithi110 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:36.504759+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:38.460942+0000 mon.a (mon.0) 137 : audit [DBG] from='client.? 172.21.15.110:0/413032441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:38.505191+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:40.448721+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:40.454544+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:40.460593+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:40.461940+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:46.324 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: audit 2024-09-21T04:51:40.463640+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:46.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cephadm 2024-09-21T04:51:40.465576+0000 mgr.y (mgr.14150) 44 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T04:51:46.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: cluster 2024-09-21T04:51:40.505692+0000 mgr.y (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:46.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:45 smithi089 bash[26514]: debug 2024-09-21T04:51:45.981+0000 7f16ee8f8640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T04:51:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:41.551382+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:41.551674+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:41.574835+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:42.506148+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:42.545654+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:43.546921+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:43.547087+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:44.506461+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:44.546218+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:45.546443+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:45.991410+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:46.546942+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.594586+0000 mon.a (mon.0) 153 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600609+0000 mon.a (mon.0) 154 : cluster [DBG] monmap epoch 2 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600641+0000 mon.a (mon.0) 155 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600661+0000 mon.a (mon.0) 156 : cluster [DBG] last_changed 2024-09-21T04:51:41.545835+0000 2024-09-21T04:51:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600677+0000 mon.a (mon.0) 157 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600694+0000 mon.a (mon.0) 158 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600715+0000 mon.a (mon.0) 159 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600736+0000 mon.a (mon.0) 160 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.600757+0000 mon.a (mon.0) 161 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.618513+0000 mon.a (mon.0) 162 : cluster [DBG] fsmap 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.618564+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.618833+0000 mon.a (mon.0) 164 : cluster [DBG] mgrmap e13: y(active, since 62s) 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.619081+0000 mon.a (mon.0) 165 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:46.625293+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:46.632185+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:46.639558+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:46 smithi089 bash[19831]: audit 2024-09-21T04:51:46.646382+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:41.551382+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:41.551674+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:41.574835+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:42.506148+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:42.545654+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:43.546921+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:43.547087+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:44.506461+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:44.546218+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:45.546443+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:45.991410+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:46.546942+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.594586+0000 mon.a (mon.0) 153 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600609+0000 mon.a (mon.0) 154 : cluster [DBG] monmap epoch 2 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600641+0000 mon.a (mon.0) 155 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600661+0000 mon.a (mon.0) 156 : cluster [DBG] last_changed 2024-09-21T04:51:41.545835+0000 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600677+0000 mon.a (mon.0) 157 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600694+0000 mon.a (mon.0) 158 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600715+0000 mon.a (mon.0) 159 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600736+0000 mon.a (mon.0) 160 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.600757+0000 mon.a (mon.0) 161 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.618513+0000 mon.a (mon.0) 162 : cluster [DBG] fsmap 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.618564+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.618833+0000 mon.a (mon.0) 164 : cluster [DBG] mgrmap e13: y(active, since 62s) 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.619081+0000 mon.a (mon.0) 165 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:46.625293+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:46.632185+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:46.639558+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:46 smithi110 bash[22020]: audit 2024-09-21T04:51:46.646382+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:47.327 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 2 2024-09-21T04:51:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:51:47.327 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":2,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","modified":"2024-09-21T04:51:41.545835Z","created":"2024-09-21T04:49:40.825749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T04:51:48.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:47 smithi110 bash[22020]: cluster 2024-09-21T04:51:46.506890+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:48.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:47 smithi110 bash[22020]: audit 2024-09-21T04:51:46.706225+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:48.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:47 smithi110 bash[22020]: audit 2024-09-21T04:51:46.991844+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:48.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:47 smithi110 bash[22020]: audit 2024-09-21T04:51:47.327953+0000 mon.a (mon.0) 172 : audit [DBG] from='client.? 172.21.15.110:0/3921831701' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:48.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:47 smithi110 bash[22020]: audit 2024-09-21T04:51:47.547089+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:48.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:47 smithi089 bash[19831]: cluster 2024-09-21T04:51:46.506890+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:47 smithi089 bash[19831]: audit 2024-09-21T04:51:46.706225+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:47 smithi089 bash[19831]: audit 2024-09-21T04:51:46.991844+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:47 smithi089 bash[19831]: audit 2024-09-21T04:51:47.327953+0000 mon.a (mon.0) 172 : audit [DBG] from='client.? 172.21.15.110:0/3921831701' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:47 smithi089 bash[19831]: audit 2024-09-21T04:51:47.547089+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:49.041 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T04:51:49.041 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T04:51:53.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:47.999256+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:47.999741+0000 mon.a (mon.0) 176 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:48.001452+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:48.019006+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:48.019409+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:48.507273+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:48.992736+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:49.992995+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:49.995260+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:50.507654+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:50.993027+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:51.992059+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:52.508044+0000 mgr.y (mgr.14150) 51 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:52.993406+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.039340+0000 mon.a (mon.0) 184 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047518+0000 mon.a (mon.0) 185 : cluster [DBG] monmap epoch 3 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047551+0000 mon.a (mon.0) 186 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047569+0000 mon.a (mon.0) 187 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047607+0000 mon.a (mon.0) 188 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047641+0000 mon.a (mon.0) 189 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047660+0000 mon.a (mon.0) 190 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047679+0000 mon.a (mon.0) 191 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:53.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047698+0000 mon.a (mon.0) 192 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:41.551382+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:41.551674+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:41.574835+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:42.506148+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:42.545654+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:43.546921+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:43.547087+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:44.506461+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:44.546218+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:45.546443+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:45.991410+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.546942+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.594586+0000 mon.a (mon.0) 153 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600609+0000 mon.a (mon.0) 154 : cluster [DBG] monmap epoch 2 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600641+0000 mon.a (mon.0) 155 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600661+0000 mon.a (mon.0) 156 : cluster [DBG] last_changed 2024-09-21T04:51:41.545835+0000 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600677+0000 mon.a (mon.0) 157 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600694+0000 mon.a (mon.0) 158 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600715+0000 mon.a (mon.0) 159 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600736+0000 mon.a (mon.0) 160 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.600757+0000 mon.a (mon.0) 161 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.618513+0000 mon.a (mon.0) 162 : cluster [DBG] fsmap 2024-09-21T04:51:53.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.618564+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.047718+0000 mon.a (mon.0) 193 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.070522+0000 mon.a (mon.0) 194 : cluster [DBG] fsmap 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.070572+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.070844+0000 mon.a (mon.0) 196 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: cluster 2024-09-21T04:51:53.071090+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:53.078273+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:53.083908+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:53.089628+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:53.095591+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[19831]: audit 2024-09-21T04:51:53.101487+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.618833+0000 mon.a (mon.0) 164 : cluster [DBG] mgrmap e13: y(active, since 62s) 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.619081+0000 mon.a (mon.0) 165 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.625293+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.632185+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.639558+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.646382+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:46.506890+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.706225+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:46.991844+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:47.327953+0000 mon.a (mon.0) 172 : audit [DBG] from='client.? 172.21.15.110:0/3921831701' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:47.547089+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:47.999256+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:47.999741+0000 mon.a (mon.0) 176 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:48.001452+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:48.019006+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:48.019409+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.303 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:48.507273+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:48.992736+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:49.992995+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:49.995260+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:50.507654+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:50.993027+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:51.992059+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:52.508044+0000 mgr.y (mgr.14150) 51 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:52.993406+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.039340+0000 mon.a (mon.0) 184 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047518+0000 mon.a (mon.0) 185 : cluster [DBG] monmap epoch 3 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047551+0000 mon.a (mon.0) 186 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:53.304 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047569+0000 mon.a (mon.0) 187 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047607+0000 mon.a (mon.0) 188 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047641+0000 mon.a (mon.0) 189 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047660+0000 mon.a (mon.0) 190 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047679+0000 mon.a (mon.0) 191 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047698+0000 mon.a (mon.0) 192 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.047718+0000 mon.a (mon.0) 193 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.070522+0000 mon.a (mon.0) 194 : cluster [DBG] fsmap 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.070572+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.070844+0000 mon.a (mon.0) 196 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: cluster 2024-09-21T04:51:53.071090+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:53.078273+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:53.083908+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:53.089628+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:53.095591+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:53 smithi089 bash[26514]: audit 2024-09-21T04:51:53.101487+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:47.999256+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:47.999741+0000 mon.a (mon.0) 176 : cluster [INF] mon.a calling monitor election 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:48.001452+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:48.019006+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:48.019409+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:48.507273+0000 mgr.y (mgr.14150) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:48.992736+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:49.992995+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:49.995260+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:50.507654+0000 mgr.y (mgr.14150) 50 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:50.993027+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:51.992059+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:52.508044+0000 mgr.y (mgr.14150) 51 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:52.993406+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.039340+0000 mon.a (mon.0) 184 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047518+0000 mon.a (mon.0) 185 : cluster [DBG] monmap epoch 3 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047551+0000 mon.a (mon.0) 186 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047569+0000 mon.a (mon.0) 187 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047607+0000 mon.a (mon.0) 188 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047641+0000 mon.a (mon.0) 189 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047660+0000 mon.a (mon.0) 190 : cluster [DBG] election_strategy: 1 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047679+0000 mon.a (mon.0) 191 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047698+0000 mon.a (mon.0) 192 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.047718+0000 mon.a (mon.0) 193 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T04:51:53.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.070522+0000 mon.a (mon.0) 194 : cluster [DBG] fsmap 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.070572+0000 mon.a (mon.0) 195 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.070844+0000 mon.a (mon.0) 196 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: cluster 2024-09-21T04:51:53.071090+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:53.078273+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:53.083908+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:53.089628+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:53.095591+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.559 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:53 smithi110 bash[22020]: audit 2024-09-21T04:51:53.101487+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:53.735 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:53.770723+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:53.772169+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:53.992474+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:54.037213+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:54.041705+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[26514]: audit 2024-09-21T04:51:54.132194+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:53.770723+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:53.772169+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:53.992474+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:54.037213+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:54.041705+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:54 smithi089 bash[19831]: audit 2024-09-21T04:51:54.132194+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:53.770723+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:53.772169+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:53.992474+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:54.037213+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:54.041705+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:54 smithi110 bash[22020]: audit 2024-09-21T04:51:54.132194+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:51:55.297 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","modified":"2024-09-21T04:51:47.992950Z","created":"2024-09-21T04:49:40.825749Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T04:51:55.297 INFO:teuthology.orchestra.run.smithi110.stderr:dumped monmap epoch 3 2024-09-21T04:51:55.495 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:53.774099+0000 mgr.y (mgr.14150) 52 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T04:51:55.495 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:53.774383+0000 mgr.y (mgr.14150) 53 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T04:51:55.495 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:53.912168+0000 mgr.y (mgr.14150) 54 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.495 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:53.917698+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.495 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.144036+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.150761+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.193363+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.198919+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.204257+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.209677+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:54.210173+0000 mgr.y (mgr.14150) 56 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.210628+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.212020+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: audit 2024-09-21T04:51:54.213312+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cephadm 2024-09-21T04:51:54.214694+0000 mgr.y (mgr.14150) 57 : cephadm [INF] Reconfiguring daemon mon.a on smithi089 2024-09-21T04:51:55.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:55 smithi110 bash[22020]: cluster 2024-09-21T04:51:54.508424+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:53.774099+0000 mgr.y (mgr.14150) 52 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:53.774383+0000 mgr.y (mgr.14150) 53 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:53.912168+0000 mgr.y (mgr.14150) 54 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:53.917698+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.144036+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.150761+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.193363+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.198919+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.204257+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.209677+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:54.210173+0000 mgr.y (mgr.14150) 56 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.210628+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.212020+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: audit 2024-09-21T04:51:54.213312+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cephadm 2024-09-21T04:51:54.214694+0000 mgr.y (mgr.14150) 57 : cephadm [INF] Reconfiguring daemon mon.a on smithi089 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[26514]: cluster 2024-09-21T04:51:54.508424+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:53.774099+0000 mgr.y (mgr.14150) 52 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:53.774383+0000 mgr.y (mgr.14150) 53 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T04:51:55.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:53.912168+0000 mgr.y (mgr.14150) 54 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:53.917698+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.144036+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.150761+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.193363+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.198919+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.204257+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.209677+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:54.210173+0000 mgr.y (mgr.14150) 56 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.210628+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.212020+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: audit 2024-09-21T04:51:54.213312+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cephadm 2024-09-21T04:51:54.214694+0000 mgr.y (mgr.14150) 57 : cephadm [INF] Reconfiguring daemon mon.a on smithi089 2024-09-21T04:51:55.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:55 smithi089 bash[19831]: cluster 2024-09-21T04:51:54.508424+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:55.922 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T04:51:55.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T04:51:56.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:56 smithi089 bash[19831]: audit 2024-09-21T04:51:55.297384+0000 mon.a (mon.0) 218 : audit [DBG] from='client.? 172.21.15.110:0/278525778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:56.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:56 smithi089 bash[26514]: audit 2024-09-21T04:51:55.297384+0000 mon.a (mon.0) 218 : audit [DBG] from='client.? 172.21.15.110:0/278525778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:56 smithi110 bash[22020]: audit 2024-09-21T04:51:55.297384+0000 mon.a (mon.0) 218 : audit [DBG] from='client.? 172.21.15.110:0/278525778' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T04:51:58.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: cluster 2024-09-21T04:51:56.508810+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: audit 2024-09-21T04:51:56.747810+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: audit 2024-09-21T04:51:56.753253+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: audit 2024-09-21T04:51:56.754687+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: audit 2024-09-21T04:51:56.756168+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[26514]: audit 2024-09-21T04:51:56.757521+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: cluster 2024-09-21T04:51:56.508810+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: audit 2024-09-21T04:51:56.747810+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: audit 2024-09-21T04:51:56.753253+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: audit 2024-09-21T04:51:56.754687+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: audit 2024-09-21T04:51:56.756168+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:57 smithi089 bash[19831]: audit 2024-09-21T04:51:56.757521+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: cluster 2024-09-21T04:51:56.508810+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: audit 2024-09-21T04:51:56.747810+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: audit 2024-09-21T04:51:56.753253+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: audit 2024-09-21T04:51:56.754687+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: audit 2024-09-21T04:51:56.756168+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:51:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:57 smithi110 bash[22020]: audit 2024-09-21T04:51:56.757521+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:51:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:58 smithi089 bash[19831]: cephadm 2024-09-21T04:51:56.754212+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-21T04:51:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:58 smithi089 bash[19831]: cephadm 2024-09-21T04:51:56.758969+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Reconfiguring daemon mon.c on smithi089 2024-09-21T04:51:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:58 smithi089 bash[26514]: cephadm 2024-09-21T04:51:56.754212+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-21T04:51:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:58 smithi089 bash[26514]: cephadm 2024-09-21T04:51:56.758969+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Reconfiguring daemon mon.c on smithi089 2024-09-21T04:51:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:58 smithi110 bash[22020]: cephadm 2024-09-21T04:51:56.754212+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-21T04:51:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:58 smithi110 bash[22020]: cephadm 2024-09-21T04:51:56.758969+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Reconfiguring daemon mon.c on smithi089 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: cluster 2024-09-21T04:51:58.509299+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: audit 2024-09-21T04:51:58.821435+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: audit 2024-09-21T04:51:58.827316+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: cephadm 2024-09-21T04:51:58.828453+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: audit 2024-09-21T04:51:58.828852+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: audit 2024-09-21T04:51:58.829882+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: audit 2024-09-21T04:51:58.830870+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[26514]: cephadm 2024-09-21T04:51:58.832182+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.b on smithi110 2024-09-21T04:52:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: cluster 2024-09-21T04:51:58.509299+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: audit 2024-09-21T04:51:58.821435+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: audit 2024-09-21T04:51:58.827316+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: cephadm 2024-09-21T04:51:58.828453+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: audit 2024-09-21T04:51:58.828852+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: audit 2024-09-21T04:51:58.829882+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: audit 2024-09-21T04:51:58.830870+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:51:59 smithi089 bash[19831]: cephadm 2024-09-21T04:51:58.832182+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.b on smithi110 2024-09-21T04:52:00.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: cluster 2024-09-21T04:51:58.509299+0000 mgr.y (mgr.14150) 62 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:00.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: audit 2024-09-21T04:51:58.821435+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: audit 2024-09-21T04:51:58.827316+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:00.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: cephadm 2024-09-21T04:51:58.828453+0000 mgr.y (mgr.14150) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-21T04:52:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: audit 2024-09-21T04:51:58.828852+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T04:52:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: audit 2024-09-21T04:51:58.829882+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T04:52:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: audit 2024-09-21T04:51:58.830870+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:51:59 smithi110 bash[22020]: cephadm 2024-09-21T04:51:58.832182+0000 mgr.y (mgr.14150) 64 : cephadm [INF] Reconfiguring daemon mon.b on smithi110 2024-09-21T04:52:00.644 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:52:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:00 smithi089 bash[19831]: cluster 2024-09-21T04:52:00.509755+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:00 smithi089 bash[26514]: cluster 2024-09-21T04:52:00.509755+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:00 smithi110 bash[22020]: cluster 2024-09-21T04:52:00.509755+0000 mgr.y (mgr.14150) 65 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.833977+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.843049+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.845482+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.848660+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.850394+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[19831]: audit 2024-09-21T04:52:00.860795+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.833977+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.843049+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.845482+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.848660+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.850394+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:01 smithi089 bash[26514]: audit 2024-09-21T04:52:00.860795+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.076 INFO:teuthology.orchestra.run.smithi089.stdout:# minimal ceph.conf for bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:52:02.076 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-21T04:52:02.076 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T04:52:02.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon_host = [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.833977+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.843049+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.845482+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.848660+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.850394+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:02.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:01 smithi110 bash[22020]: audit 2024-09-21T04:52:00.860795+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:02.724 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T04:52:02.724 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:52:02.724 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T04:52:02.738 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:52:02.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:52:02.793 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:52:02.794 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T04:52:02.808 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:52:02.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T04:52:02.865 INFO:tasks.cephadm:Adding mgr.y on smithi089 2024-09-21T04:52:02.865 INFO:tasks.cephadm:Adding mgr.x on smithi110 2024-09-21T04:52:02.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply mgr '2;smithi089=y;smithi110=x' 2024-09-21T04:52:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:02 smithi089 bash[19831]: audit 2024-09-21T04:52:02.076239+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.15.89:0/2087498785' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:02 smithi089 bash[19831]: cluster 2024-09-21T04:52:02.510192+0000 mgr.y (mgr.14150) 66 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:02 smithi089 bash[26514]: audit 2024-09-21T04:52:02.076239+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.15.89:0/2087498785' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:02 smithi089 bash[26514]: cluster 2024-09-21T04:52:02.510192+0000 mgr.y (mgr.14150) 66 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:02 smithi110 bash[22020]: audit 2024-09-21T04:52:02.076239+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.15.89:0/2087498785' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:02 smithi110 bash[22020]: cluster 2024-09-21T04:52:02.510192+0000 mgr.y (mgr.14150) 66 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:05 smithi089 bash[19831]: cluster 2024-09-21T04:52:04.510627+0000 mgr.y (mgr.14150) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:05 smithi089 bash[26514]: cluster 2024-09-21T04:52:04.510627+0000 mgr.y (mgr.14150) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:06.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:05 smithi110 bash[22020]: cluster 2024-09-21T04:52:04.510627+0000 mgr.y (mgr.14150) 67 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:06.617 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:52:07.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:07 smithi110 bash[22020]: cluster 2024-09-21T04:52:06.511060+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:07.848 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled mgr update... 2024-09-21T04:52:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:07 smithi089 bash[19831]: cluster 2024-09-21T04:52:06.511060+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:07 smithi089 bash[26514]: cluster 2024-09-21T04:52:06.511060+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:08.458 DEBUG:teuthology.orchestra.run.smithi110:mgr.x> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T04:52:08.460 DEBUG:tasks.cephadm:set 0 configs 2024-09-21T04:52:08.460 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T04:52:08.461 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T04:52:08.461 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T04:52:08.467 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T04:52:08.467 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 04:44:54.264822778 +0000 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 04:44:53.996825171 +0000 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 04:44:53.996825171 +0000 2024-09-21T04:52:08.515 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-21T04:52:08.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T04:52:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T04:52:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T04:52:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000480397 s, 1.1 MB/s 2024-09-21T04:52:08.574 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T04:52:08.623 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-21T04:52:08.669 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 04:44:54.740818526 +0000 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 04:44:54.480820848 +0000 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 04:44:54.480820848 +0000 2024-09-21T04:52:08.670 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-21T04:52:08.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T04:52:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T04:52:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T04:52:08.724 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000369868 s, 1.4 MB/s 2024-09-21T04:52:08.725 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T04:52:08.775 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 04:44:55.232814131 +0000 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 04:44:54.992816274 +0000 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 04:44:54.992816274 +0000 2024-09-21T04:52:08.826 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-21T04:52:08.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T04:52:08.880 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T04:52:08.880 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T04:52:08.881 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000426438 s, 1.2 MB/s 2024-09-21T04:52:08.881 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T04:52:08.931 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-21T04:52:08.977 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T04:52:08.977 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 04:44:55.736809629 +0000 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 04:44:55.492811809 +0000 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 04:44:55.492811809 +0000 2024-09-21T04:52:08.978 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-09-21T04:52:08.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T04:52:09.032 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T04:52:09.032 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T04:52:09.032 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000384339 s, 1.3 MB/s 2024-09-21T04:52:09.033 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T04:52:09.083 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T04:52:09.083 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T04:52:09.089 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T04:52:09.089 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-21 04:44:54.000534536 +0000 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-21 04:44:53.756536717 +0000 2024-09-21T04:52:09.141 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-21 04:44:53.756536717 +0000 2024-09-21T04:52:09.142 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-21T04:52:09.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.837710+0000 mgr.y (mgr.14150) 69 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi089=y;smithi110=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: cephadm 2024-09-21T04:52:07.840601+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Saving service mgr spec with placement smithi089=y;smithi110=x;count:2 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.846786+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.848544+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.851733+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.853372+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:09.194 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.862170+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.865229+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.868189+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.872981+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: audit 2024-09-21T04:52:07.874815+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: cephadm 2024-09-21T04:52:07.876718+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T04:52:09.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:08 smithi110 bash[22020]: cluster 2024-09-21T04:52:08.511456+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:09.196 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-21T04:52:09.196 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-21T04:52:09.196 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000314623 s, 1.6 MB/s 2024-09-21T04:52:09.197 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T04:52:09.246 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-21 04:44:54.484530214 +0000 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-21 04:44:54.216532608 +0000 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-21 04:44:54.216532608 +0000 2024-09-21T04:52:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-21T04:52:09.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.837710+0000 mgr.y (mgr.14150) 69 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi089=y;smithi110=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: cephadm 2024-09-21T04:52:07.840601+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Saving service mgr spec with placement smithi089=y;smithi110=x;count:2 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.846786+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.848544+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.851733+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.853372+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.862170+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.865229+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.868189+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.872981+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: audit 2024-09-21T04:52:07.874815+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: cephadm 2024-09-21T04:52:07.876718+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[19831]: cluster 2024-09-21T04:52:08.511456+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.837710+0000 mgr.y (mgr.14150) 69 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi089=y;smithi110=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: cephadm 2024-09-21T04:52:07.840601+0000 mgr.y (mgr.14150) 70 : cephadm [INF] Saving service mgr spec with placement smithi089=y;smithi110=x;count:2 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.846786+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.848544+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.851733+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.853372+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.862170+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.865229+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:09.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.868189+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T04:52:09.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.872981+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:09.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: audit 2024-09-21T04:52:07.874815+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:09.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: cephadm 2024-09-21T04:52:07.876718+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T04:52:09.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:08 smithi089 bash[26514]: cluster 2024-09-21T04:52:08.511456+0000 mgr.y (mgr.14150) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-21T04:52:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-21T04:52:09.351 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000204567 s, 2.5 MB/s 2024-09-21T04:52:09.352 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T04:52:09.402 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-21 04:44:55.016525462 +0000 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-21 04:44:54.736527964 +0000 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-21 04:44:54.736527964 +0000 2024-09-21T04:52:09.454 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-21T04:52:09.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T04:52:09.507 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-21T04:52:09.507 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-21T04:52:09.508 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000310976 s, 1.6 MB/s 2024-09-21T04:52:09.509 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T04:52:09.561 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-21 04:44:55.248523390 +0000 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-21 04:44:55.244523426 +0000 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-21 04:44:55.244523426 +0000 2024-09-21T04:52:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-21T04:52:09.612 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T04:52:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-21T04:52:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-21T04:52:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000160232 s, 3.2 MB/s 2024-09-21T04:52:09.666 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T04:52:09.714 INFO:tasks.cephadm:Deploying osd.0 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-21T04:52:09.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T04:52:10.756 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:10.756 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:10.756 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:10.756 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:11.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:11.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:11.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:10 smithi110 systemd[1]: Started Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T04:52:11.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: cluster 2024-09-21T04:52:10.511887+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:11.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: audit 2024-09-21T04:52:10.900416+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:11.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: audit 2024-09-21T04:52:10.907647+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:11.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: audit 2024-09-21T04:52:10.915070+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:11.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: audit 2024-09-21T04:52:10.922656+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:11.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22020]: audit 2024-09-21T04:52:10.973510+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: cluster 2024-09-21T04:52:10.511887+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: audit 2024-09-21T04:52:10.900416+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: audit 2024-09-21T04:52:10.907647+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: audit 2024-09-21T04:52:10.915070+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: audit 2024-09-21T04:52:10.922656+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[19831]: audit 2024-09-21T04:52:10.973510+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: cluster 2024-09-21T04:52:10.511887+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: audit 2024-09-21T04:52:10.900416+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: audit 2024-09-21T04:52:10.907647+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: audit 2024-09-21T04:52:10.915070+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: audit 2024-09-21T04:52:10.922656+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:11 smithi089 bash[26514]: audit 2024-09-21T04:52:10.973510+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:12.307 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:11 smithi110 bash[22903]: debug 2024-09-21T04:52:11.946+0000 7f2229695640 1 -- 172.21.15.110:0/2411425355 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573e4a830e0 con 0x5573e4a84800 2024-09-21T04:52:12.307 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:12 smithi110 bash[22903]: debug 2024-09-21T04:52:12.050+0000 7f222beff040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T04:52:13.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:13 smithi110 bash[22903]: debug 2024-09-21T04:52:13.234+0000 7f222beff040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T04:52:13.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:13 smithi110 bash[22903]: debug 2024-09-21T04:52:13.298+0000 7f222beff040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T04:52:13.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:13 smithi110 bash[22903]: debug 2024-09-21T04:52:13.446+0000 7f222beff040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T04:52:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:13 smithi089 bash[19831]: cluster 2024-09-21T04:52:12.512307+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:13 smithi089 bash[19831]: audit 2024-09-21T04:52:13.086466+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:14.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:13 smithi089 bash[26514]: cluster 2024-09-21T04:52:12.512307+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:14.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:13 smithi089 bash[26514]: audit 2024-09-21T04:52:13.086466+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:13 smithi110 bash[22020]: cluster 2024-09-21T04:52:12.512307+0000 mgr.y (mgr.14150) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:13 smithi110 bash[22020]: audit 2024-09-21T04:52:13.086466+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:14.420 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.094+0000 7f222beff040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T04:52:14.420 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.166+0000 7f222beff040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T04:52:14.420 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.234+0000 7f222beff040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T04:52:14.450 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:52:14.807 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.414+0000 7f222beff040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T04:52:14.807 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.494+0000 7f222beff040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T04:52:14.807 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.558+0000 7f222beff040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T04:52:15.078 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.814+0000 7f222beff040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T04:52:15.078 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:14 smithi110 bash[22903]: debug 2024-09-21T04:52:14.882+0000 7f222beff040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T04:52:15.403 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.074+0000 7f222beff040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T04:52:15.403 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.150+0000 7f222beff040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T04:52:15.647 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:15 smithi089 bash[19831]: cluster 2024-09-21T04:52:14.512718+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:15.647 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:15 smithi089 bash[26514]: cluster 2024-09-21T04:52:14.512718+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:15.741 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22020]: cluster 2024-09-21T04:52:14.512718+0000 mgr.y (mgr.14150) 75 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:15.742 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.398+0000 7f222beff040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T04:52:15.742 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.574+0000 7f222beff040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:52:15.999 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.738+0000 7f222beff040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T04:52:15.999 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.814+0000 7f222beff040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T04:52:17.133 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:15 smithi110 bash[22903]: debug 2024-09-21T04:52:15.994+0000 7f222beff040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T04:52:17.133 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:16 smithi110 bash[22903]: debug 2024-09-21T04:52:16.830+0000 7f222beff040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T04:52:17.133 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:16 smithi110 bash[22903]: debug 2024-09-21T04:52:16.906+0000 7f222beff040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T04:52:17.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.216209+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.223824+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.225178+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.227011+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.237557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: cephadm 2024-09-21T04:52:16.295531+0000 mgr.y (mgr.14150) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.296166+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.298039+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: audit 2024-09-21T04:52:16.299590+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: cephadm 2024-09-21T04:52:16.301257+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi089 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[19831]: cluster 2024-09-21T04:52:16.512989+0000 mgr.y (mgr.14150) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:17.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.216209+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.223824+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.225178+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.227011+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.237557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: cephadm 2024-09-21T04:52:16.295531+0000 mgr.y (mgr.14150) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.296166+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.298039+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: audit 2024-09-21T04:52:16.299590+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: cephadm 2024-09-21T04:52:16.301257+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi089 2024-09-21T04:52:17.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:17 smithi089 bash[26514]: cluster 2024-09-21T04:52:16.512989+0000 mgr.y (mgr.14150) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:17.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22903]: debug 2024-09-21T04:52:17.126+0000 7f222beff040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T04:52:17.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22903]: debug 2024-09-21T04:52:17.202+0000 7f222beff040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T04:52:17.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.216209+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.223824+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.225178+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.227011+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.237557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: cephadm 2024-09-21T04:52:16.295531+0000 mgr.y (mgr.14150) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.296166+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.298039+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: audit 2024-09-21T04:52:16.299590+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: cephadm 2024-09-21T04:52:16.301257+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi089 2024-09-21T04:52:17.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22020]: cluster 2024-09-21T04:52:16.512989+0000 mgr.y (mgr.14150) 78 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:18.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22903]: debug 2024-09-21T04:52:17.590+0000 7f222beff040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T04:52:18.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:52:17 smithi110 bash[22903]: debug 2024-09-21T04:52:17.666+0000 7f222beff040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T04:52:18.187 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:52:18.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[19831]: cluster 2024-09-21T04:52:17.692124+0000 mon.a (mon.0) 259 : cluster [DBG] Standby manager daemon x started 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[19831]: audit 2024-09-21T04:52:17.692397+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[19831]: audit 2024-09-21T04:52:17.693237+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[19831]: audit 2024-09-21T04:52:17.694237+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[19831]: audit 2024-09-21T04:52:17.694616+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[26514]: cluster 2024-09-21T04:52:17.692124+0000 mon.a (mon.0) 259 : cluster [DBG] Standby manager daemon x started 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[26514]: audit 2024-09-21T04:52:17.692397+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[26514]: audit 2024-09-21T04:52:17.693237+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T04:52:18.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[26514]: audit 2024-09-21T04:52:17.694237+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T04:52:18.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:18 smithi089 bash[26514]: audit 2024-09-21T04:52:17.694616+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T04:52:18.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:18 smithi110 bash[22020]: cluster 2024-09-21T04:52:17.692124+0000 mon.a (mon.0) 259 : cluster [DBG] Standby manager daemon x started 2024-09-21T04:52:18.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:18 smithi110 bash[22020]: audit 2024-09-21T04:52:17.692397+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T04:52:18.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:18 smithi110 bash[22020]: audit 2024-09-21T04:52:17.693237+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T04:52:18.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:18 smithi110 bash[22020]: audit 2024-09-21T04:52:17.694237+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T04:52:18.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:18 smithi110 bash[22020]: audit 2024-09-21T04:52:17.694616+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.110:0/2152613633' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[26514]: cluster 2024-09-21T04:52:18.253996+0000 mon.a (mon.0) 260 : cluster [DBG] mgrmap e14: y(active, since 93s), standbys: x 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[26514]: audit 2024-09-21T04:52:18.254156+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[26514]: cluster 2024-09-21T04:52:18.513269+0000 mgr.y (mgr.14150) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[19831]: cluster 2024-09-21T04:52:18.253996+0000 mon.a (mon.0) 260 : cluster [DBG] mgrmap e14: y(active, since 93s), standbys: x 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[19831]: audit 2024-09-21T04:52:18.254156+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T04:52:19.505 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:19 smithi089 bash[19831]: cluster 2024-09-21T04:52:18.513269+0000 mgr.y (mgr.14150) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:19.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:19 smithi110 bash[22020]: cluster 2024-09-21T04:52:18.253996+0000 mon.a (mon.0) 260 : cluster [DBG] mgrmap e14: y(active, since 93s), standbys: x 2024-09-21T04:52:19.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:19 smithi110 bash[22020]: audit 2024-09-21T04:52:18.254156+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T04:52:19.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:19 smithi110 bash[22020]: cluster 2024-09-21T04:52:18.513269+0000 mgr.y (mgr.14150) 79 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.950586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.958322+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.961433+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.964613+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.966265+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: audit 2024-09-21T04:52:19.975215+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[19831]: cluster 2024-09-21T04:52:20.513699+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.950586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.958322+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.961433+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.964613+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.966265+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: audit 2024-09-21T04:52:19.975215+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:20 smithi089 bash[26514]: cluster 2024-09-21T04:52:20.513699+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.950586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.958322+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.961433+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.964613+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:21.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.966265+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:21.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: audit 2024-09-21T04:52:19.975215+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:21.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:20 smithi110 bash[22020]: cluster 2024-09-21T04:52:20.513699+0000 mgr.y (mgr.14150) 80 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:22.956 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:52:23.898 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:23 smithi089 bash[19831]: cluster 2024-09-21T04:52:22.514122+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:23.898 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:23 smithi089 bash[26514]: cluster 2024-09-21T04:52:22.514122+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:24.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:23 smithi110 bash[22020]: cluster 2024-09-21T04:52:22.514122+0000 mgr.y (mgr.14150) 81 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[26514]: audit 2024-09-21T04:52:24.232793+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[26514]: audit 2024-09-21T04:52:24.238521+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[26514]: audit 2024-09-21T04:52:24.239959+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[19831]: audit 2024-09-21T04:52:24.232793+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[19831]: audit 2024-09-21T04:52:24.238521+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:52:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:24 smithi089 bash[19831]: audit 2024-09-21T04:52:24.239959+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:25.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:24 smithi110 bash[22020]: audit 2024-09-21T04:52:24.232793+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:52:25.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:24 smithi110 bash[22020]: audit 2024-09-21T04:52:24.238521+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:52:25.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:24 smithi110 bash[22020]: audit 2024-09-21T04:52:24.239959+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:25 smithi089 bash[19831]: audit 2024-09-21T04:52:24.226503+0000 mgr.y (mgr.14150) 82 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:25 smithi089 bash[19831]: cluster 2024-09-21T04:52:24.514574+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:25 smithi089 bash[26514]: audit 2024-09-21T04:52:24.226503+0000 mgr.y (mgr.14150) 82 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:25 smithi089 bash[26514]: cluster 2024-09-21T04:52:24.514574+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:26.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:25 smithi110 bash[22020]: audit 2024-09-21T04:52:24.226503+0000 mgr.y (mgr.14150) 82 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:52:26.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:25 smithi110 bash[22020]: cluster 2024-09-21T04:52:24.514574+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:28.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:27 smithi089 bash[19831]: cluster 2024-09-21T04:52:26.515025+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:27 smithi089 bash[26514]: cluster 2024-09-21T04:52:26.515025+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:28.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:27 smithi110 bash[22020]: cluster 2024-09-21T04:52:26.515025+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:29.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:29 smithi089 bash[19831]: cluster 2024-09-21T04:52:28.515538+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:29.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:29 smithi089 bash[26514]: cluster 2024-09-21T04:52:28.515538+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:30.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:29 smithi110 bash[22020]: cluster 2024-09-21T04:52:28.515538+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:31.940 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:31 smithi089 bash[19831]: cluster 2024-09-21T04:52:30.515992+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:31.941 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:31 smithi089 bash[26514]: cluster 2024-09-21T04:52:30.515992+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:32.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:31 smithi110 bash[22020]: cluster 2024-09-21T04:52:30.515992+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: cluster 2024-09-21T04:52:32.516376+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: audit 2024-09-21T04:52:32.727135+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.89:0/815692485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: audit 2024-09-21T04:52:32.727636+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: audit 2024-09-21T04:52:32.732197+0000 mon.a (mon.0) 272 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]': finished 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: cluster 2024-09-21T04:52:32.739066+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: audit 2024-09-21T04:52:32.739280+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:52:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[19831]: audit 2024-09-21T04:52:33.350865+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/690705152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: cluster 2024-09-21T04:52:32.516376+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: audit 2024-09-21T04:52:32.727135+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.89:0/815692485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: audit 2024-09-21T04:52:32.727636+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: audit 2024-09-21T04:52:32.732197+0000 mon.a (mon.0) 272 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]': finished 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: cluster 2024-09-21T04:52:32.739066+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: audit 2024-09-21T04:52:32.739280+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:52:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:33 smithi089 bash[26514]: audit 2024-09-21T04:52:33.350865+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/690705152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:52:34.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: cluster 2024-09-21T04:52:32.516376+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: audit 2024-09-21T04:52:32.727135+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.89:0/815692485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: audit 2024-09-21T04:52:32.727636+0000 mon.a (mon.0) 271 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]: dispatch 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: audit 2024-09-21T04:52:32.732197+0000 mon.a (mon.0) 272 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cedd9ea3-6157-4152-a26d-369dff19cffa"}]': finished 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: cluster 2024-09-21T04:52:32.739066+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: audit 2024-09-21T04:52:32.739280+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:52:34.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:33 smithi110 bash[22020]: audit 2024-09-21T04:52:33.350865+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/690705152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:52:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:35 smithi089 bash[19831]: cluster 2024-09-21T04:52:34.516775+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:36.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:35 smithi089 bash[26514]: cluster 2024-09-21T04:52:34.516775+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:36.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:35 smithi110 bash[22020]: cluster 2024-09-21T04:52:34.516775+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:38.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:37 smithi089 bash[19831]: cluster 2024-09-21T04:52:36.517133+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:38.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:37 smithi089 bash[26514]: cluster 2024-09-21T04:52:36.517133+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:38.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:37 smithi110 bash[22020]: cluster 2024-09-21T04:52:36.517133+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:40.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:39 smithi089 bash[19831]: cluster 2024-09-21T04:52:38.517653+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:40.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:39 smithi089 bash[26514]: cluster 2024-09-21T04:52:38.517653+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:39 smithi110 bash[22020]: cluster 2024-09-21T04:52:38.517653+0000 mgr.y (mgr.14150) 90 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:41 smithi089 bash[19831]: cluster 2024-09-21T04:52:40.518106+0000 mgr.y (mgr.14150) 91 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:41 smithi089 bash[26514]: cluster 2024-09-21T04:52:40.518106+0000 mgr.y (mgr.14150) 91 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:42.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:41 smithi110 bash[22020]: cluster 2024-09-21T04:52:40.518106+0000 mgr.y (mgr.14150) 91 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:43.677 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:43 smithi089 bash[19831]: cluster 2024-09-21T04:52:42.518543+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:43.677 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:43 smithi089 bash[26514]: cluster 2024-09-21T04:52:42.518543+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:43 smithi110 bash[22020]: cluster 2024-09-21T04:52:42.518543+0000 mgr.y (mgr.14150) 92 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:45 smithi089 bash[19831]: cluster 2024-09-21T04:52:44.518985+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:45.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:45 smithi089 bash[26514]: cluster 2024-09-21T04:52:44.518985+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:46.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:45 smithi110 bash[22020]: cluster 2024-09-21T04:52:44.518985+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:46.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:46 smithi089 bash[19831]: audit 2024-09-21T04:52:45.981082+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T04:52:46.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:46 smithi089 bash[19831]: audit 2024-09-21T04:52:45.982543+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:46.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:46 smithi089 bash[26514]: audit 2024-09-21T04:52:45.981082+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T04:52:46.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:46 smithi089 bash[26514]: audit 2024-09-21T04:52:45.982543+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:46 smithi110 bash[22020]: audit 2024-09-21T04:52:45.981082+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T04:52:47.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:46 smithi110 bash[22020]: audit 2024-09-21T04:52:45.982543+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:47.917 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:47 smithi089 bash[26514]: cephadm 2024-09-21T04:52:45.983851+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T04:52:47.917 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:47 smithi089 bash[26514]: cluster 2024-09-21T04:52:46.519259+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:47.917 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:47 smithi089 bash[19831]: cephadm 2024-09-21T04:52:45.983851+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T04:52:47.918 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:47 smithi089 bash[19831]: cluster 2024-09-21T04:52:46.519259+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:48.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:47 smithi110 bash[22020]: cephadm 2024-09-21T04:52:45.983851+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T04:52:48.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:47 smithi110 bash[22020]: cluster 2024-09-21T04:52:46.519259+0000 mgr.y (mgr.14150) 95 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:49.860 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:49 smithi089 bash[19831]: cluster 2024-09-21T04:52:48.519627+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:49.860 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:49 smithi089 bash[26514]: cluster 2024-09-21T04:52:48.519627+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:49 smithi110 bash[22020]: cluster 2024-09-21T04:52:48.519627+0000 mgr.y (mgr.14150) 96 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:50.592 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:50.593 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:50.593 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:50.943 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:50.943 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:50.943 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:50 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:52:52.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[26514]: cluster 2024-09-21T04:52:50.519957+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:52.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[26514]: audit 2024-09-21T04:52:50.863484+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:52.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[26514]: audit 2024-09-21T04:52:50.868934+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:52.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[26514]: audit 2024-09-21T04:52:50.874645+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:52.039 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[19831]: cluster 2024-09-21T04:52:50.519957+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:52.039 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[19831]: audit 2024-09-21T04:52:50.863484+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:52.039 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[19831]: audit 2024-09-21T04:52:50.868934+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:52.039 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:51 smithi089 bash[19831]: audit 2024-09-21T04:52:50.874645+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:51 smithi110 bash[22020]: cluster 2024-09-21T04:52:50.519957+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:52.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:51 smithi110 bash[22020]: audit 2024-09-21T04:52:50.863484+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:52:52.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:51 smithi110 bash[22020]: audit 2024-09-21T04:52:50.868934+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:52.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:51 smithi110 bash[22020]: audit 2024-09-21T04:52:50.874645+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:53.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:53 smithi089 bash[19831]: cluster 2024-09-21T04:52:52.520289+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:53.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:53 smithi089 bash[26514]: cluster 2024-09-21T04:52:52.520289+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:54.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:53 smithi110 bash[22020]: cluster 2024-09-21T04:52:52.520289+0000 mgr.y (mgr.14150) 98 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:56.040 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:55 smithi089 bash[19831]: cluster 2024-09-21T04:52:54.520544+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:56.040 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:55 smithi089 bash[26514]: cluster 2024-09-21T04:52:54.520544+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:56.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:55 smithi110 bash[22020]: cluster 2024-09-21T04:52:54.520544+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:57.249 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: audit 2024-09-21T04:52:56.128914+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: audit 2024-09-21T04:52:56.132884+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: cluster 2024-09-21T04:52:56.520878+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: audit 2024-09-21T04:52:56.754763+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: audit 2024-09-21T04:52:56.755741+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[19831]: audit 2024-09-21T04:52:56.760456+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: audit 2024-09-21T04:52:56.128914+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: audit 2024-09-21T04:52:56.132884+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: cluster 2024-09-21T04:52:56.520878+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: audit 2024-09-21T04:52:56.754763+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: audit 2024-09-21T04:52:56.755741+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:57.250 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:57 smithi089 bash[26514]: audit 2024-09-21T04:52:56.760456+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: audit 2024-09-21T04:52:56.128914+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: audit 2024-09-21T04:52:56.132884+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: cluster 2024-09-21T04:52:56.520878+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: audit 2024-09-21T04:52:56.754763+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: audit 2024-09-21T04:52:56.755741+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:52:57.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:57 smithi110 bash[22020]: audit 2024-09-21T04:52:56.760456+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:52:59.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:52:59 smithi089 bash[26514]: cluster 2024-09-21T04:52:58.521292+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:52:59.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:52:59 smithi089 bash[19831]: cluster 2024-09-21T04:52:58.521292+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:52:59 smithi110 bash[22020]: cluster 2024-09-21T04:52:58.521292+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:00.642 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 0 on host 'smithi089' 2024-09-21T04:53:00.865 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:00 smithi089 bash[19831]: audit 2024-09-21T04:52:59.606819+0000 mon.a (mon.0) 285 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T04:53:00.865 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:00 smithi089 bash[26514]: audit 2024-09-21T04:52:59.606819+0000 mon.a (mon.0) 285 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T04:53:01.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:00 smithi110 bash[22020]: audit 2024-09-21T04:52:59.606819+0000 mon.a (mon.0) 285 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T04:53:01.299 DEBUG:teuthology.orchestra.run.smithi089:osd.0> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T04:53:01.301 INFO:tasks.cephadm:Deploying osd.1 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-21T04:53:01.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T04:53:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: cluster 2024-09-21T04:53:00.521734+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.582997+0000 mon.a (mon.0) 286 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: cluster 2024-09-21T04:53:00.586851+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.587263+0000 mon.a (mon.0) 288 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.587626+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.620397+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.627786+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[26514]: audit 2024-09-21T04:53:00.635737+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: cluster 2024-09-21T04:53:00.521734+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.582997+0000 mon.a (mon.0) 286 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: cluster 2024-09-21T04:53:00.586851+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-21T04:53:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.587263+0000 mon.a (mon.0) 288 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:02.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.587626+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:02.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.620397+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:02.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.627786+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:02.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[19831]: audit 2024-09-21T04:53:00.635737+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:02.050 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[29494]: debug 2024-09-21T04:53:01.629+0000 7f6440705640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T04:53:02.050 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:53:01 smithi089 bash[29494]: debug 2024-09-21T04:53:01.629+0000 7f643c52d640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T04:53:02.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: cluster 2024-09-21T04:53:00.521734+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.582997+0000 mon.a (mon.0) 286 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: cluster 2024-09-21T04:53:00.586851+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.587263+0000 mon.a (mon.0) 288 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.587626+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.620397+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.627786+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:02.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:01 smithi110 bash[22020]: audit 2024-09-21T04:53:00.635737+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:03.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[19831]: audit 2024-09-21T04:53:01.584606+0000 mon.a (mon.0) 293 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:03.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[19831]: cluster 2024-09-21T04:53:01.592111+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-21T04:53:03.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[19831]: audit 2024-09-21T04:53:01.593213+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[19831]: audit 2024-09-21T04:53:01.600775+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[26514]: audit 2024-09-21T04:53:01.584606+0000 mon.a (mon.0) 293 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[26514]: cluster 2024-09-21T04:53:01.592111+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-21T04:53:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[26514]: audit 2024-09-21T04:53:01.593213+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:02 smithi089 bash[26514]: audit 2024-09-21T04:53:01.600775+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:03.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:02 smithi110 bash[22020]: audit 2024-09-21T04:53:01.584606+0000 mon.a (mon.0) 293 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:03.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:02 smithi110 bash[22020]: cluster 2024-09-21T04:53:01.592111+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-21T04:53:03.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:02 smithi110 bash[22020]: audit 2024-09-21T04:53:01.593213+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:03.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:02 smithi110 bash[22020]: audit 2024-09-21T04:53:01.600775+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: cluster 2024-09-21T04:53:00.638935+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: cluster 2024-09-21T04:53:00.639066+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: cluster 2024-09-21T04:53:02.522144+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: audit 2024-09-21T04:53:02.605817+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: cluster 2024-09-21T04:53:02.615880+0000 mon.a (mon.0) 298 : cluster [INF] osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973] boot 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: cluster 2024-09-21T04:53:02.616014+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[19831]: audit 2024-09-21T04:53:02.616626+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: cluster 2024-09-21T04:53:00.638935+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: cluster 2024-09-21T04:53:00.639066+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:04.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: cluster 2024-09-21T04:53:02.522144+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:04.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: audit 2024-09-21T04:53:02.605817+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: cluster 2024-09-21T04:53:02.615880+0000 mon.a (mon.0) 298 : cluster [INF] osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973] boot 2024-09-21T04:53:04.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: cluster 2024-09-21T04:53:02.616014+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-21T04:53:04.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:03 smithi089 bash[26514]: audit 2024-09-21T04:53:02.616626+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: cluster 2024-09-21T04:53:00.638935+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: cluster 2024-09-21T04:53:00.639066+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: cluster 2024-09-21T04:53:02.522144+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: audit 2024-09-21T04:53:02.605817+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: cluster 2024-09-21T04:53:02.615880+0000 mon.a (mon.0) 298 : cluster [INF] osd.0 [v2:172.21.15.89:6802/334393973,v1:172.21.15.89:6803/334393973] boot 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: cluster 2024-09-21T04:53:02.616014+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-21T04:53:04.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:03 smithi110 bash[22020]: audit 2024-09-21T04:53:02.616626+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T04:53:05.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:04 smithi089 bash[19831]: cluster 2024-09-21T04:53:03.617218+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-21T04:53:05.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:04 smithi089 bash[26514]: cluster 2024-09-21T04:53:03.617218+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-21T04:53:05.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:04 smithi110 bash[22020]: cluster 2024-09-21T04:53:03.617218+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-21T04:53:05.656 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:53:06.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:05 smithi089 bash[19831]: cluster 2024-09-21T04:53:04.522539+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:06.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:05 smithi089 bash[26514]: cluster 2024-09-21T04:53:04.522539+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:06.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:05 smithi110 bash[22020]: cluster 2024-09-21T04:53:04.522539+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:07.955 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:07 smithi089 bash[19831]: cluster 2024-09-21T04:53:06.523021+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:07.956 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:07 smithi089 bash[26514]: cluster 2024-09-21T04:53:06.523021+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:08.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:07 smithi110 bash[22020]: cluster 2024-09-21T04:53:06.523021+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:09 smithi089 bash[26514]: cluster 2024-09-21T04:53:08.523435+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:09.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:09 smithi089 bash[19831]: cluster 2024-09-21T04:53:08.523435+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:10.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:09 smithi110 bash[22020]: cluster 2024-09-21T04:53:08.523435+0000 mgr.y (mgr.14150) 106 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:10.631 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:53:10.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-21T04:53:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:11 smithi089 bash[19831]: cluster 2024-09-21T04:53:10.523896+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:11 smithi089 bash[26514]: cluster 2024-09-21T04:53:10.523896+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:12.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:11 smithi110 bash[22020]: cluster 2024-09-21T04:53:10.523896+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: cluster 2024-09-21T04:53:12.524380+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.353951+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.363797+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.366400+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.375764+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.379838+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.381574+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[19831]: audit 2024-09-21T04:53:13.391402+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: cluster 2024-09-21T04:53:12.524380+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.353951+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.363797+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.366400+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.375764+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.379838+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.381574+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:13 smithi089 bash[26514]: audit 2024-09-21T04:53:13.391402+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: cluster 2024-09-21T04:53:12.524380+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.353951+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.363797+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.366400+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.375764+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.379838+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.381574+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:14.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:13 smithi110 bash[22020]: audit 2024-09-21T04:53:13.391402+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:14 smithi089 bash[19831]: cephadm 2024-09-21T04:53:13.345950+0000 mgr.y (mgr.14150) 109 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:53:15.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:14 smithi089 bash[19831]: cephadm 2024-09-21T04:53:13.367700+0000 mgr.y (mgr.14150) 110 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 16241M 2024-09-21T04:53:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:14 smithi089 bash[26514]: cephadm 2024-09-21T04:53:13.345950+0000 mgr.y (mgr.14150) 109 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:53:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:14 smithi089 bash[26514]: cephadm 2024-09-21T04:53:13.367700+0000 mgr.y (mgr.14150) 110 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 16241M 2024-09-21T04:53:15.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:14 smithi110 bash[22020]: cephadm 2024-09-21T04:53:13.345950+0000 mgr.y (mgr.14150) 109 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:53:15.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:14 smithi110 bash[22020]: cephadm 2024-09-21T04:53:13.367700+0000 mgr.y (mgr.14150) 110 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 16241M 2024-09-21T04:53:15.804 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:53:15.914 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:15 smithi089 bash[19831]: cluster 2024-09-21T04:53:14.524872+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:15.915 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:15 smithi089 bash[26514]: cluster 2024-09-21T04:53:14.524872+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:16.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:15 smithi110 bash[22020]: cluster 2024-09-21T04:53:14.524872+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[19831]: cluster 2024-09-21T04:53:16.525331+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[19831]: audit 2024-09-21T04:53:17.185086+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[19831]: audit 2024-09-21T04:53:17.190305+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[19831]: audit 2024-09-21T04:53:17.191724+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[26514]: cluster 2024-09-21T04:53:16.525331+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[26514]: audit 2024-09-21T04:53:17.185086+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[26514]: audit 2024-09-21T04:53:17.190305+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:53:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:17 smithi089 bash[26514]: audit 2024-09-21T04:53:17.191724+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:17 smithi110 bash[22020]: cluster 2024-09-21T04:53:16.525331+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:17 smithi110 bash[22020]: audit 2024-09-21T04:53:17.185086+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:53:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:17 smithi110 bash[22020]: audit 2024-09-21T04:53:17.190305+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:53:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:17 smithi110 bash[22020]: audit 2024-09-21T04:53:17.191724+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:19.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:18 smithi089 bash[19831]: audit 2024-09-21T04:53:17.178879+0000 mgr.y (mgr.14150) 113 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:19.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:18 smithi089 bash[26514]: audit 2024-09-21T04:53:17.178879+0000 mgr.y (mgr.14150) 113 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:19.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:18 smithi110 bash[22020]: audit 2024-09-21T04:53:17.178879+0000 mgr.y (mgr.14150) 113 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:53:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:19 smithi089 bash[19831]: cluster 2024-09-21T04:53:18.525789+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:20.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:19 smithi089 bash[26514]: cluster 2024-09-21T04:53:18.525789+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:20.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:19 smithi110 bash[22020]: cluster 2024-09-21T04:53:18.525789+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:21 smithi089 bash[19831]: cluster 2024-09-21T04:53:20.526234+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:21 smithi089 bash[26514]: cluster 2024-09-21T04:53:20.526234+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:21 smithi110 bash[22020]: cluster 2024-09-21T04:53:20.526234+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:23.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:23 smithi089 bash[26514]: cluster 2024-09-21T04:53:22.526734+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:23 smithi089 bash[19831]: cluster 2024-09-21T04:53:22.526734+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:24.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:23 smithi110 bash[22020]: cluster 2024-09-21T04:53:22.526734+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[26514]: cluster 2024-09-21T04:53:24.527237+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[26514]: audit 2024-09-21T04:53:25.573129+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]: dispatch 2024-09-21T04:53:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[26514]: audit 2024-09-21T04:53:25.576067+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]': finished 2024-09-21T04:53:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[26514]: cluster 2024-09-21T04:53:25.579621+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-21T04:53:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[26514]: audit 2024-09-21T04:53:25.579941+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:26.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[19831]: cluster 2024-09-21T04:53:24.527237+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:26.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[19831]: audit 2024-09-21T04:53:25.573129+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]: dispatch 2024-09-21T04:53:26.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[19831]: audit 2024-09-21T04:53:25.576067+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]': finished 2024-09-21T04:53:26.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[19831]: cluster 2024-09-21T04:53:25.579621+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-21T04:53:26.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:25 smithi089 bash[19831]: audit 2024-09-21T04:53:25.579941+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:26.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:25 smithi110 bash[22020]: cluster 2024-09-21T04:53:24.527237+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:26.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:25 smithi110 bash[22020]: audit 2024-09-21T04:53:25.573129+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]: dispatch 2024-09-21T04:53:26.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:25 smithi110 bash[22020]: audit 2024-09-21T04:53:25.576067+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.89:0/109232197' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f0b6d96-66a0-4fe1-a8a3-340baef4cf82"}]': finished 2024-09-21T04:53:26.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:25 smithi110 bash[22020]: cluster 2024-09-21T04:53:25.579621+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-21T04:53:26.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:25 smithi110 bash[22020]: audit 2024-09-21T04:53:25.579941+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:26 smithi089 bash[19831]: audit 2024-09-21T04:53:26.251323+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.89:0/1627087784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:53:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:26 smithi089 bash[26514]: audit 2024-09-21T04:53:26.251323+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.89:0/1627087784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:53:27.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:26 smithi110 bash[22020]: audit 2024-09-21T04:53:26.251323+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.89:0/1627087784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:53:28.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:27 smithi089 bash[19831]: cluster 2024-09-21T04:53:26.527645+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:27 smithi089 bash[26514]: cluster 2024-09-21T04:53:26.527645+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:28.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:27 smithi110 bash[22020]: cluster 2024-09-21T04:53:26.527645+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:29.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:29 smithi089 bash[19831]: cluster 2024-09-21T04:53:28.528099+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:29.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:29 smithi089 bash[26514]: cluster 2024-09-21T04:53:28.528099+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:30.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:29 smithi110 bash[22020]: cluster 2024-09-21T04:53:28.528099+0000 mgr.y (mgr.14150) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:32.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:31 smithi089 bash[19831]: cluster 2024-09-21T04:53:30.528537+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:31 smithi089 bash[26514]: cluster 2024-09-21T04:53:30.528537+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:32.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:31 smithi110 bash[22020]: cluster 2024-09-21T04:53:30.528537+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:33 smithi089 bash[19831]: cluster 2024-09-21T04:53:32.528990+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:33 smithi089 bash[26514]: cluster 2024-09-21T04:53:32.528990+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:34.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:33 smithi110 bash[22020]: cluster 2024-09-21T04:53:32.528990+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:35 smithi089 bash[19831]: cluster 2024-09-21T04:53:34.529419+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:35 smithi089 bash[26514]: cluster 2024-09-21T04:53:34.529419+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:36.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:35 smithi110 bash[22020]: cluster 2024-09-21T04:53:34.529419+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:38.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:37 smithi089 bash[19831]: cluster 2024-09-21T04:53:36.529817+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:38.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:37 smithi089 bash[26514]: cluster 2024-09-21T04:53:36.529817+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:38.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:37 smithi110 bash[22020]: cluster 2024-09-21T04:53:36.529817+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:40.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[19831]: cluster 2024-09-21T04:53:38.530194+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:40.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[19831]: audit 2024-09-21T04:53:38.884942+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T04:53:40.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[19831]: audit 2024-09-21T04:53:38.886624+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[26514]: cluster 2024-09-21T04:53:38.530194+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[26514]: audit 2024-09-21T04:53:38.884942+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T04:53:40.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:39 smithi089 bash[26514]: audit 2024-09-21T04:53:38.886624+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:39 smithi110 bash[22020]: cluster 2024-09-21T04:53:38.530194+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:39 smithi110 bash[22020]: audit 2024-09-21T04:53:38.884942+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T04:53:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:39 smithi110 bash[22020]: audit 2024-09-21T04:53:38.886624+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:41.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:40 smithi089 bash[19831]: cephadm 2024-09-21T04:53:38.887882+0000 mgr.y (mgr.14150) 125 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T04:53:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:40 smithi089 bash[26514]: cephadm 2024-09-21T04:53:38.887882+0000 mgr.y (mgr.14150) 125 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T04:53:41.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:40 smithi110 bash[22020]: cephadm 2024-09-21T04:53:38.887882+0000 mgr.y (mgr.14150) 125 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T04:53:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:41 smithi089 bash[19831]: cluster 2024-09-21T04:53:40.530525+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:42.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:41 smithi089 bash[26514]: cluster 2024-09-21T04:53:40.530525+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:42.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:41 smithi110 bash[22020]: cluster 2024-09-21T04:53:40.530525+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:43.356 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.356 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.356 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.357 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.703 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.703 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.703 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:43.704 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:53:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[26514]: cluster 2024-09-21T04:53:42.530928+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[26514]: audit 2024-09-21T04:53:43.597585+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[26514]: audit 2024-09-21T04:53:43.601639+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[26514]: audit 2024-09-21T04:53:43.606203+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[19831]: cluster 2024-09-21T04:53:42.530928+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[19831]: audit 2024-09-21T04:53:43.597585+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[19831]: audit 2024-09-21T04:53:43.601639+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:43 smithi089 bash[19831]: audit 2024-09-21T04:53:43.606203+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:43 smithi110 bash[22020]: cluster 2024-09-21T04:53:42.530928+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:43 smithi110 bash[22020]: audit 2024-09-21T04:53:43.597585+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:43 smithi110 bash[22020]: audit 2024-09-21T04:53:43.601639+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:43 smithi110 bash[22020]: audit 2024-09-21T04:53:43.606203+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:46.035 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:45 smithi089 bash[26514]: cluster 2024-09-21T04:53:44.531360+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:46.035 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:45 smithi089 bash[19831]: cluster 2024-09-21T04:53:44.531360+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:46.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:45 smithi110 bash[22020]: cluster 2024-09-21T04:53:44.531360+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:47.978 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:47 smithi089 bash[19831]: cluster 2024-09-21T04:53:46.531820+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:47.978 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:47 smithi089 bash[26514]: cluster 2024-09-21T04:53:46.531820+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:48.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:47 smithi110 bash[22020]: cluster 2024-09-21T04:53:46.531820+0000 mgr.y (mgr.14150) 129 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:50.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:49 smithi089 bash[19831]: cluster 2024-09-21T04:53:48.532328+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:50.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:49 smithi089 bash[26514]: cluster 2024-09-21T04:53:48.532328+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:49 smithi110 bash[22020]: cluster 2024-09-21T04:53:48.532328+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:51.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: audit 2024-09-21T04:53:49.941651+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: audit 2024-09-21T04:53:49.946318+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: audit 2024-09-21T04:53:49.947137+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: audit 2024-09-21T04:53:49.947867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: audit 2024-09-21T04:53:49.953054+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[19831]: cluster 2024-09-21T04:53:50.532784+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: audit 2024-09-21T04:53:49.941651+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: audit 2024-09-21T04:53:49.946318+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: audit 2024-09-21T04:53:49.947137+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: audit 2024-09-21T04:53:49.947867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:51.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: audit 2024-09-21T04:53:49.953054+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:50 smithi089 bash[26514]: cluster 2024-09-21T04:53:50.532784+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: audit 2024-09-21T04:53:49.941651+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: audit 2024-09-21T04:53:49.946318+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: audit 2024-09-21T04:53:49.947137+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: audit 2024-09-21T04:53:49.947867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: audit 2024-09-21T04:53:49.953054+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:51.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:50 smithi110 bash[22020]: cluster 2024-09-21T04:53:50.532784+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[19831]: cluster 2024-09-21T04:53:52.533083+0000 mgr.y (mgr.14150) 132 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[19831]: audit 2024-09-21T04:53:53.019013+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[19831]: audit 2024-09-21T04:53:53.019371+0000 mon.a (mon.0) 327 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[26514]: cluster 2024-09-21T04:53:52.533083+0000 mgr.y (mgr.14150) 132 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[26514]: audit 2024-09-21T04:53:53.019013+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:53.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:53 smithi089 bash[26514]: audit 2024-09-21T04:53:53.019371+0000 mon.a (mon.0) 327 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:54.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:53 smithi110 bash[22020]: cluster 2024-09-21T04:53:52.533083+0000 mgr.y (mgr.14150) 132 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:54.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:53 smithi110 bash[22020]: audit 2024-09-21T04:53:53.019013+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:54.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:53 smithi110 bash[22020]: audit 2024-09-21T04:53:53.019371+0000 mon.a (mon.0) 327 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T04:53:54.180 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 1 on host 'smithi089' 2024-09-21T04:53:54.784 DEBUG:teuthology.orchestra.run.smithi089:osd.1> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T04:53:54.787 INFO:tasks.cephadm:Deploying osd.2 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-21T04:53:54.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T04:53:55.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:53.587761+0000 mon.a (mon.0) 328 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T04:53:55.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: cluster 2024-09-21T04:53:53.594090+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-21T04:53:55.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:53.595116+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:53.595307+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:53.596208+0000 mon.a (mon.0) 331 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:54.155484+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:54.163031+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:54.172257+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:54.589523+0000 mon.a (mon.0) 335 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: cluster 2024-09-21T04:53:54.594027+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[19831]: audit 2024-09-21T04:53:54.594577+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:53.587761+0000 mon.a (mon.0) 328 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T04:53:55.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: cluster 2024-09-21T04:53:53.594090+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:53.595116+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:53.595307+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:53.596208+0000 mon.a (mon.0) 331 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:54.155484+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:54.163031+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:54.172257+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:54.589523+0000 mon.a (mon.0) 335 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: cluster 2024-09-21T04:53:54.594027+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-21T04:53:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:54 smithi089 bash[26514]: audit 2024-09-21T04:53:54.594577+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:53.587761+0000 mon.a (mon.0) 328 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T04:53:55.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: cluster 2024-09-21T04:53:53.594090+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-21T04:53:55.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:53.595116+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:53.595307+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:53.596208+0000 mon.a (mon.0) 331 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:54.155484+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:54.163031+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:54.172257+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:54.589523+0000 mon.a (mon.0) 335 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: cluster 2024-09-21T04:53:54.594027+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-21T04:53:55.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:54 smithi110 bash[22020]: audit 2024-09-21T04:53:54.594577+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:55.549 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[34752]: debug 2024-09-21T04:53:55.067+0000 7f994bd55640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T04:53:55.549 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[34752]: debug 2024-09-21T04:53:55.131+0000 7f9943361640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T04:53:56.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[19831]: cluster 2024-09-21T04:53:54.533515+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:56.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[19831]: audit 2024-09-21T04:53:54.601875+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:56.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[19831]: audit 2024-09-21T04:53:55.077760+0000 mon.a (mon.0) 339 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-21T04:53:56.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[19831]: audit 2024-09-21T04:53:55.600101+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:56.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[26514]: cluster 2024-09-21T04:53:54.533515+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:56.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[26514]: audit 2024-09-21T04:53:54.601875+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:56.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[26514]: audit 2024-09-21T04:53:55.077760+0000 mon.a (mon.0) 339 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-21T04:53:56.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:55 smithi089 bash[26514]: audit 2024-09-21T04:53:55.600101+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:56.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:55 smithi110 bash[22020]: cluster 2024-09-21T04:53:54.533515+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:56.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:55 smithi110 bash[22020]: audit 2024-09-21T04:53:54.601875+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:56.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:55 smithi110 bash[22020]: audit 2024-09-21T04:53:55.077760+0000 mon.a (mon.0) 339 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-21T04:53:56.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:55 smithi110 bash[22020]: audit 2024-09-21T04:53:55.600101+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:57.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[19831]: cluster 2024-09-21T04:53:54.066713+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:57.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[19831]: cluster 2024-09-21T04:53:54.066826+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[19831]: cluster 2024-09-21T04:53:56.083333+0000 mon.a (mon.0) 341 : cluster [INF] osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341] boot 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[19831]: cluster 2024-09-21T04:53:56.083430+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[19831]: audit 2024-09-21T04:53:56.083700+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[26514]: cluster 2024-09-21T04:53:54.066713+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[26514]: cluster 2024-09-21T04:53:54.066826+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[26514]: cluster 2024-09-21T04:53:56.083333+0000 mon.a (mon.0) 341 : cluster [INF] osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341] boot 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[26514]: cluster 2024-09-21T04:53:56.083430+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-21T04:53:57.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:56 smithi089 bash[26514]: audit 2024-09-21T04:53:56.083700+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:57.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:56 smithi110 bash[22020]: cluster 2024-09-21T04:53:54.066713+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:53:57.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:56 smithi110 bash[22020]: cluster 2024-09-21T04:53:54.066826+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:53:57.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:56 smithi110 bash[22020]: cluster 2024-09-21T04:53:56.083333+0000 mon.a (mon.0) 341 : cluster [INF] osd.1 [v2:172.21.15.89:6810/542485341,v1:172.21.15.89:6811/542485341] boot 2024-09-21T04:53:57.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:56 smithi110 bash[22020]: cluster 2024-09-21T04:53:56.083430+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-21T04:53:57.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:56 smithi110 bash[22020]: audit 2024-09-21T04:53:56.083700+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T04:53:58.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:57 smithi089 bash[19831]: cluster 2024-09-21T04:53:56.533935+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:57 smithi089 bash[26514]: cluster 2024-09-21T04:53:56.533935+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:58.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:57 smithi110 bash[22020]: cluster 2024-09-21T04:53:56.533935+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T04:53:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:58 smithi089 bash[19831]: cluster 2024-09-21T04:53:57.660708+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-21T04:53:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:58 smithi089 bash[26514]: cluster 2024-09-21T04:53:57.660708+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-21T04:53:59.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:58 smithi110 bash[22020]: cluster 2024-09-21T04:53:57.660708+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-21T04:53:59.236 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:54:00.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:53:59 smithi089 bash[19831]: cluster 2024-09-21T04:53:58.534375+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:53:59 smithi089 bash[26514]: cluster 2024-09-21T04:53:58.534375+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:00.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:53:59 smithi110 bash[22020]: cluster 2024-09-21T04:53:58.534375+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:01.973 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:01 smithi089 bash[19831]: cluster 2024-09-21T04:54:00.534826+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:01.973 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:01 smithi089 bash[26514]: cluster 2024-09-21T04:54:00.534826+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:02.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:01 smithi110 bash[22020]: cluster 2024-09-21T04:54:00.534826+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:03.928 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:03 smithi089 bash[19831]: cluster 2024-09-21T04:54:02.535298+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:03.928 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:03 smithi089 bash[26514]: cluster 2024-09-21T04:54:02.535298+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:04.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:03 smithi110 bash[22020]: cluster 2024-09-21T04:54:02.535298+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: cluster 2024-09-21T04:54:04.535705+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: cephadm 2024-09-21T04:54:04.560607+0000 mgr.y (mgr.14150) 139 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.568359+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.575171+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.577312+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.578766+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: cephadm 2024-09-21T04:54:04.579748+0000 mgr.y (mgr.14150) 140 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 8120M 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.584317+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.587061+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.588293+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[26514]: audit 2024-09-21T04:54:04.598144+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: cluster 2024-09-21T04:54:04.535705+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: cephadm 2024-09-21T04:54:04.560607+0000 mgr.y (mgr.14150) 139 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.568359+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.575171+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.577312+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.578766+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: cephadm 2024-09-21T04:54:04.579748+0000 mgr.y (mgr.14150) 140 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 8120M 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.584317+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.587061+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.588293+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:05.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:05 smithi089 bash[19831]: audit 2024-09-21T04:54:04.598144+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:06.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: cluster 2024-09-21T04:54:04.535705+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:06.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: cephadm 2024-09-21T04:54:04.560607+0000 mgr.y (mgr.14150) 139 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:54:06.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.568359+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.575171+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.577312+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.578766+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: cephadm 2024-09-21T04:54:04.579748+0000 mgr.y (mgr.14150) 140 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 8120M 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.584317+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.587061+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.588293+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:06.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:05 smithi110 bash[22020]: audit 2024-09-21T04:54:04.598144+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:06.683 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:54:06.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-21T04:54:08.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:07 smithi089 bash[19831]: cluster 2024-09-21T04:54:06.536177+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:08.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:07 smithi089 bash[26514]: cluster 2024-09-21T04:54:06.536177+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:08.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:07 smithi110 bash[22020]: cluster 2024-09-21T04:54:06.536177+0000 mgr.y (mgr.14150) 141 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:10.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:09 smithi089 bash[19831]: cluster 2024-09-21T04:54:08.536664+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:09 smithi089 bash[26514]: cluster 2024-09-21T04:54:08.536664+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:10.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:09 smithi110 bash[22020]: cluster 2024-09-21T04:54:08.536664+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:11.486 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:54:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:11 smithi089 bash[19831]: cluster 2024-09-21T04:54:10.537112+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:11 smithi089 bash[26514]: cluster 2024-09-21T04:54:10.537112+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:12.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:11 smithi110 bash[22020]: cluster 2024-09-21T04:54:10.537112+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[19831]: cluster 2024-09-21T04:54:12.537469+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[19831]: audit 2024-09-21T04:54:12.897838+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[19831]: audit 2024-09-21T04:54:12.903233+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[19831]: audit 2024-09-21T04:54:12.904602+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[26514]: cluster 2024-09-21T04:54:12.537469+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[26514]: audit 2024-09-21T04:54:12.897838+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[26514]: audit 2024-09-21T04:54:12.903233+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:54:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:13 smithi089 bash[26514]: audit 2024-09-21T04:54:12.904602+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:13 smithi110 bash[22020]: cluster 2024-09-21T04:54:12.537469+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:13 smithi110 bash[22020]: audit 2024-09-21T04:54:12.897838+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:54:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:13 smithi110 bash[22020]: audit 2024-09-21T04:54:12.903233+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:54:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:13 smithi110 bash[22020]: audit 2024-09-21T04:54:12.904602+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:14 smithi089 bash[19831]: audit 2024-09-21T04:54:12.891747+0000 mgr.y (mgr.14150) 145 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:14 smithi089 bash[26514]: audit 2024-09-21T04:54:12.891747+0000 mgr.y (mgr.14150) 145 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:15.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:14 smithi110 bash[22020]: audit 2024-09-21T04:54:12.891747+0000 mgr.y (mgr.14150) 145 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:54:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:15 smithi089 bash[19831]: cluster 2024-09-21T04:54:14.537939+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:15 smithi089 bash[26514]: cluster 2024-09-21T04:54:14.537939+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:16.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:15 smithi110 bash[22020]: cluster 2024-09-21T04:54:14.537939+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:17 smithi089 bash[26514]: cluster 2024-09-21T04:54:16.538423+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:17 smithi089 bash[19831]: cluster 2024-09-21T04:54:16.538423+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:17 smithi110 bash[22020]: cluster 2024-09-21T04:54:16.538423+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:20.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:19 smithi089 bash[19831]: cluster 2024-09-21T04:54:18.538877+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:20.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:19 smithi089 bash[26514]: cluster 2024-09-21T04:54:18.538877+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:20.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:19 smithi110 bash[22020]: cluster 2024-09-21T04:54:18.538877+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: cluster 2024-09-21T04:54:20.539374+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: audit 2024-09-21T04:54:21.303471+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.89:0/3986372637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: audit 2024-09-21T04:54:21.303894+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: audit 2024-09-21T04:54:21.305979+0000 mon.a (mon.0) 357 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]': finished 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: cluster 2024-09-21T04:54:21.309664+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[26514]: audit 2024-09-21T04:54:21.309944+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: cluster 2024-09-21T04:54:20.539374+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: audit 2024-09-21T04:54:21.303471+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.89:0/3986372637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: audit 2024-09-21T04:54:21.303894+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: audit 2024-09-21T04:54:21.305979+0000 mon.a (mon.0) 357 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]': finished 2024-09-21T04:54:22.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: cluster 2024-09-21T04:54:21.309664+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-21T04:54:22.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:21 smithi089 bash[19831]: audit 2024-09-21T04:54:21.309944+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: cluster 2024-09-21T04:54:20.539374+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: audit 2024-09-21T04:54:21.303471+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.89:0/3986372637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: audit 2024-09-21T04:54:21.303894+0000 mon.a (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]: dispatch 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: audit 2024-09-21T04:54:21.305979+0000 mon.a (mon.0) 357 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14556fdf-44d6-48ab-a2ef-8449f4a60ce9"}]': finished 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: cluster 2024-09-21T04:54:21.309664+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-21T04:54:22.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:21 smithi110 bash[22020]: audit 2024-09-21T04:54:21.309944+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:23.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:22 smithi089 bash[26514]: audit 2024-09-21T04:54:21.949793+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/3274828630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:54:23.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:22 smithi089 bash[19831]: audit 2024-09-21T04:54:21.949793+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/3274828630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:54:23.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:22 smithi110 bash[22020]: audit 2024-09-21T04:54:21.949793+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/3274828630' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:54:24.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:23 smithi089 bash[19831]: cluster 2024-09-21T04:54:22.539798+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:24.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:23 smithi089 bash[26514]: cluster 2024-09-21T04:54:22.539798+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:24.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:23 smithi110 bash[22020]: cluster 2024-09-21T04:54:22.539798+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:25 smithi089 bash[19831]: cluster 2024-09-21T04:54:24.540265+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:25 smithi089 bash[26514]: cluster 2024-09-21T04:54:24.540265+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:26.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:25 smithi110 bash[22020]: cluster 2024-09-21T04:54:24.540265+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:27 smithi089 bash[19831]: cluster 2024-09-21T04:54:26.540692+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:27 smithi089 bash[26514]: cluster 2024-09-21T04:54:26.540692+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:28.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:27 smithi110 bash[22020]: cluster 2024-09-21T04:54:26.540692+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:30.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:29 smithi089 bash[19831]: cluster 2024-09-21T04:54:28.541142+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:29 smithi089 bash[26514]: cluster 2024-09-21T04:54:28.541142+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:30.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:29 smithi110 bash[22020]: cluster 2024-09-21T04:54:28.541142+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:32.036 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:31 smithi089 bash[19831]: cluster 2024-09-21T04:54:30.541589+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:32.036 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:31 smithi089 bash[26514]: cluster 2024-09-21T04:54:30.541589+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:32.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:31 smithi110 bash[22020]: cluster 2024-09-21T04:54:30.541589+0000 mgr.y (mgr.14150) 154 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:33.946 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:33 smithi089 bash[19831]: cluster 2024-09-21T04:54:32.542026+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:33.947 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:33 smithi089 bash[26514]: cluster 2024-09-21T04:54:32.542026+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:34.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:33 smithi110 bash[22020]: cluster 2024-09-21T04:54:32.542026+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:35.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:34 smithi089 bash[19831]: audit 2024-09-21T04:54:34.595268+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T04:54:35.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:34 smithi089 bash[19831]: audit 2024-09-21T04:54:34.597007+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:35.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:34 smithi089 bash[26514]: audit 2024-09-21T04:54:34.595268+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T04:54:35.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:34 smithi089 bash[26514]: audit 2024-09-21T04:54:34.597007+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:35.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:34 smithi110 bash[22020]: audit 2024-09-21T04:54:34.595268+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T04:54:35.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:34 smithi110 bash[22020]: audit 2024-09-21T04:54:34.597007+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:36.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:35 smithi089 bash[19831]: cluster 2024-09-21T04:54:34.542579+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:36.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:35 smithi089 bash[19831]: cephadm 2024-09-21T04:54:34.598514+0000 mgr.y (mgr.14150) 157 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T04:54:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:35 smithi089 bash[26514]: cluster 2024-09-21T04:54:34.542579+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:35 smithi089 bash[26514]: cephadm 2024-09-21T04:54:34.598514+0000 mgr.y (mgr.14150) 157 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T04:54:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:35 smithi110 bash[22020]: cluster 2024-09-21T04:54:34.542579+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:36.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:35 smithi110 bash[22020]: cephadm 2024-09-21T04:54:34.598514+0000 mgr.y (mgr.14150) 157 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T04:54:37.897 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:37 smithi089 bash[19831]: cluster 2024-09-21T04:54:36.543067+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:37.897 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:37 smithi089 bash[26514]: cluster 2024-09-21T04:54:36.543067+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:38.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:37 smithi110 bash[22020]: cluster 2024-09-21T04:54:36.543067+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:39.214 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.214 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:54:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.215 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:54:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.215 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:54:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.549 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:54:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.549 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:54:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:39.550 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:54:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[19831]: cluster 2024-09-21T04:54:38.543545+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[19831]: audit 2024-09-21T04:54:39.360944+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[19831]: audit 2024-09-21T04:54:39.364775+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[19831]: audit 2024-09-21T04:54:39.368912+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[26514]: cluster 2024-09-21T04:54:38.543545+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[26514]: audit 2024-09-21T04:54:39.360944+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:40.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[26514]: audit 2024-09-21T04:54:39.364775+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:39 smithi089 bash[26514]: audit 2024-09-21T04:54:39.368912+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:39 smithi110 bash[22020]: cluster 2024-09-21T04:54:38.543545+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:39 smithi110 bash[22020]: audit 2024-09-21T04:54:39.360944+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:39 smithi110 bash[22020]: audit 2024-09-21T04:54:39.364775+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:40.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:39 smithi110 bash[22020]: audit 2024-09-21T04:54:39.368912+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:41.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:41 smithi089 bash[19831]: cluster 2024-09-21T04:54:40.543915+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:41.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:41 smithi089 bash[26514]: cluster 2024-09-21T04:54:40.543915+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:41 smithi110 bash[22020]: cluster 2024-09-21T04:54:40.543915+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:43.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:43 smithi089 bash[19831]: cluster 2024-09-21T04:54:42.544274+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:43.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:43 smithi089 bash[26514]: cluster 2024-09-21T04:54:42.544274+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:44.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:43 smithi110 bash[22020]: cluster 2024-09-21T04:54:42.544274+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:45.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:45 smithi089 bash[19831]: cluster 2024-09-21T04:54:44.544796+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:45 smithi089 bash[26514]: cluster 2024-09-21T04:54:44.544796+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:46.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:45 smithi110 bash[22020]: cluster 2024-09-21T04:54:44.544796+0000 mgr.y (mgr.14150) 162 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[19831]: audit 2024-09-21T04:54:45.698326+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[19831]: audit 2024-09-21T04:54:45.702494+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[19831]: audit 2024-09-21T04:54:46.307966+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[19831]: audit 2024-09-21T04:54:46.308956+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[19831]: audit 2024-09-21T04:54:46.313384+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[26514]: audit 2024-09-21T04:54:45.698326+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[26514]: audit 2024-09-21T04:54:45.702494+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[26514]: audit 2024-09-21T04:54:46.307966+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:47.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[26514]: audit 2024-09-21T04:54:46.308956+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:47.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:46 smithi089 bash[26514]: audit 2024-09-21T04:54:46.313384+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:46 smithi110 bash[22020]: audit 2024-09-21T04:54:45.698326+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:46 smithi110 bash[22020]: audit 2024-09-21T04:54:45.702494+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:46 smithi110 bash[22020]: audit 2024-09-21T04:54:46.307966+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:46 smithi110 bash[22020]: audit 2024-09-21T04:54:46.308956+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:54:47.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:46 smithi110 bash[22020]: audit 2024-09-21T04:54:46.313384+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:48.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:47 smithi089 bash[26514]: cluster 2024-09-21T04:54:46.545120+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:48.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:47 smithi089 bash[19831]: cluster 2024-09-21T04:54:46.545120+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:48.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:47 smithi110 bash[22020]: cluster 2024-09-21T04:54:46.545120+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:49.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:48 smithi089 bash[19831]: audit 2024-09-21T04:54:48.317041+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T04:54:49.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:48 smithi089 bash[26514]: audit 2024-09-21T04:54:48.317041+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T04:54:49.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:48 smithi110 bash[22020]: audit 2024-09-21T04:54:48.317041+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T04:54:49.562 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 2 on host 'smithi089' 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: cluster 2024-09-21T04:54:48.545526+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:48.714788+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: cluster 2024-09-21T04:54:48.724864+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:48.725538+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:48.726057+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:49.538133+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:49.544282+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[19831]: audit 2024-09-21T04:54:49.553009+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: cluster 2024-09-21T04:54:48.545526+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:48.714788+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: cluster 2024-09-21T04:54:48.724864+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:48.725538+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:48.726057+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:49.538133+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:49.544282+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:49 smithi089 bash[26514]: audit 2024-09-21T04:54:49.553009+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: cluster 2024-09-21T04:54:48.545526+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:48.714788+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: cluster 2024-09-21T04:54:48.724864+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:48.725538+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:48.726057+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:49.538133+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:49.544282+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:49 smithi110 bash[22020]: audit 2024-09-21T04:54:49.553009+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:50.188 DEBUG:teuthology.orchestra.run.smithi089:osd.2> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T04:54:50.190 INFO:tasks.cephadm:Deploying osd.3 on smithi089 with /dev/vg_nvme/lv_1... 2024-09-21T04:54:50.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T04:54:51.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[19831]: audit 2024-09-21T04:54:49.716580+0000 mon.a (mon.0) 378 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:54:51.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[19831]: cluster 2024-09-21T04:54:49.721575+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-21T04:54:51.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[19831]: audit 2024-09-21T04:54:49.722720+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[19831]: audit 2024-09-21T04:54:49.734441+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[19831]: audit 2024-09-21T04:54:50.164147+0000 mon.a (mon.0) 382 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' 2024-09-21T04:54:51.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[26514]: audit 2024-09-21T04:54:49.716580+0000 mon.a (mon.0) 378 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:54:51.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[26514]: cluster 2024-09-21T04:54:49.721575+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-21T04:54:51.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[26514]: audit 2024-09-21T04:54:49.722720+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[26514]: audit 2024-09-21T04:54:49.734441+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:50 smithi089 bash[26514]: audit 2024-09-21T04:54:50.164147+0000 mon.a (mon.0) 382 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' 2024-09-21T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:50 smithi110 bash[22020]: audit 2024-09-21T04:54:49.716580+0000 mon.a (mon.0) 378 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:50 smithi110 bash[22020]: cluster 2024-09-21T04:54:49.721575+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-21T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:50 smithi110 bash[22020]: audit 2024-09-21T04:54:49.722720+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:50 smithi110 bash[22020]: audit 2024-09-21T04:54:49.734441+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:51.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:50 smithi110 bash[22020]: audit 2024-09-21T04:54:50.164147+0000 mon.a (mon.0) 382 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819]' entity='osd.2' 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: cluster 2024-09-21T04:54:49.301249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: cluster 2024-09-21T04:54:49.301354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: cluster 2024-09-21T04:54:50.546046+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: audit 2024-09-21T04:54:50.734758+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: cluster 2024-09-21T04:54:51.176195+0000 mon.a (mon.0) 384 : cluster [INF] osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819] boot 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: cluster 2024-09-21T04:54:51.176281+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-21T04:54:52.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[19831]: audit 2024-09-21T04:54:51.177400+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: cluster 2024-09-21T04:54:49.301249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: cluster 2024-09-21T04:54:49.301354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: cluster 2024-09-21T04:54:50.546046+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: audit 2024-09-21T04:54:50.734758+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: cluster 2024-09-21T04:54:51.176195+0000 mon.a (mon.0) 384 : cluster [INF] osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819] boot 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: cluster 2024-09-21T04:54:51.176281+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-21T04:54:52.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:51 smithi089 bash[26514]: audit 2024-09-21T04:54:51.177400+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:52.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: cluster 2024-09-21T04:54:49.301249+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: cluster 2024-09-21T04:54:49.301354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: cluster 2024-09-21T04:54:50.546046+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: audit 2024-09-21T04:54:50.734758+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: cluster 2024-09-21T04:54:51.176195+0000 mon.a (mon.0) 384 : cluster [INF] osd.2 [v2:172.21.15.89:6818/646968819,v1:172.21.15.89:6819/646968819] boot 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: cluster 2024-09-21T04:54:51.176281+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-21T04:54:52.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:51 smithi110 bash[22020]: audit 2024-09-21T04:54:51.177400+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T04:54:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[19831]: cluster 2024-09-21T04:54:52.194518+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-21T04:54:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[19831]: cluster 2024-09-21T04:54:52.546506+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[19831]: audit 2024-09-21T04:54:52.660801+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[26514]: cluster 2024-09-21T04:54:52.194518+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-21T04:54:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[26514]: cluster 2024-09-21T04:54:52.546506+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:53 smithi089 bash[26514]: audit 2024-09-21T04:54:52.660801+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:53.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:53 smithi110 bash[22020]: cluster 2024-09-21T04:54:52.194518+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-21T04:54:53.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:53 smithi110 bash[22020]: cluster 2024-09-21T04:54:52.546506+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:53.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:53 smithi110 bash[22020]: audit 2024-09-21T04:54:52.660801+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[19831]: audit 2024-09-21T04:54:53.196873+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[19831]: cluster 2024-09-21T04:54:53.206977+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[19831]: audit 2024-09-21T04:54:53.208402+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[26514]: audit 2024-09-21T04:54:53.196873+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[26514]: cluster 2024-09-21T04:54:53.206977+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-21T04:54:54.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:54 smithi089 bash[26514]: audit 2024-09-21T04:54:53.208402+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:54.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:54 smithi110 bash[22020]: audit 2024-09-21T04:54:53.196873+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:54.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:54 smithi110 bash[22020]: cluster 2024-09-21T04:54:53.206977+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-21T04:54:54.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:54 smithi110 bash[22020]: audit 2024-09-21T04:54:53.208402+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T04:54:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[19831]: audit 2024-09-21T04:54:54.209906+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[19831]: cluster 2024-09-21T04:54:54.217080+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[19831]: cluster 2024-09-21T04:54:54.546894+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[26514]: audit 2024-09-21T04:54:54.209906+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[26514]: cluster 2024-09-21T04:54:54.217080+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-21T04:54:55.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:55 smithi089 bash[26514]: cluster 2024-09-21T04:54:54.546894+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:55 smithi110 bash[22020]: audit 2024-09-21T04:54:54.209906+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:54:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:55 smithi110 bash[22020]: cluster 2024-09-21T04:54:54.217080+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-21T04:54:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:55 smithi110 bash[22020]: cluster 2024-09-21T04:54:54.546894+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:56.486 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:56 smithi089 bash[19831]: cluster 2024-09-21T04:54:55.220058+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-21T04:54:56.486 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:56 smithi089 bash[19831]: audit 2024-09-21T04:54:55.604178+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:56.487 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:56 smithi089 bash[26514]: cluster 2024-09-21T04:54:55.220058+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-21T04:54:56.487 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:56 smithi089 bash[26514]: audit 2024-09-21T04:54:55.604178+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:56 smithi110 bash[22020]: cluster 2024-09-21T04:54:55.220058+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-21T04:54:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:56 smithi110 bash[22020]: audit 2024-09-21T04:54:55.604178+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:54:57.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:57 smithi089 bash[19831]: cluster 2024-09-21T04:54:56.547183+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v138: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:57.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:57 smithi089 bash[26514]: cluster 2024-09-21T04:54:56.547183+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v138: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:57.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:57 smithi110 bash[22020]: cluster 2024-09-21T04:54:56.547183+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v138: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:54:58.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:58 smithi089 bash[19831]: cluster 2024-09-21T04:54:57.243219+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-21T04:54:58.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:54:58 smithi089 bash[19831]: audit 2024-09-21T04:54:57.377066+0000 mon.a (mon.0) 397 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:54:58.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:58 smithi089 bash[26514]: cluster 2024-09-21T04:54:57.243219+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-21T04:54:58.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:54:58 smithi089 bash[26514]: audit 2024-09-21T04:54:57.377066+0000 mon.a (mon.0) 397 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:54:58.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:58 smithi110 bash[22020]: cluster 2024-09-21T04:54:57.243219+0000 mon.a (mon.0) 396 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-21T04:54:58.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:54:58 smithi110 bash[22020]: audit 2024-09-21T04:54:57.377066+0000 mon.a (mon.0) 397 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.241422+0000 mon.a (mon.0) 398 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.243590+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.248563+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.248719+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.251161+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.251380+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.251451+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:58.251581+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: cluster 2024-09-21T04:54:58.547753+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:59.136265+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:59.165086+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:59.166976+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:59.167164+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[19831]: audit 2024-09-21T04:54:59.167377+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.241422+0000 mon.a (mon.0) 398 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.243590+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.248563+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.248719+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.251161+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.251380+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.251451+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:58.251581+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: cluster 2024-09-21T04:54:58.547753+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:59.136265+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:59.165086+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:59.166976+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:59.167164+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:00 smithi089 bash[26514]: audit 2024-09-21T04:54:59.167377+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.241422+0000 mon.a (mon.0) 398 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.243590+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.248563+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.248719+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.251161+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.251380+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.251451+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:00.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:58.251581+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: cluster 2024-09-21T04:54:58.547753+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:59.136265+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:59.165086+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:59.166976+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:59.167164+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T04:55:00.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:00 smithi110 bash[22020]: audit 2024-09-21T04:54:59.167377+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:54:59.166713+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.074265+0000 mon.c (mon.2) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: cephadm 2024-09-21T04:55:00.091565+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.096493+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.102323+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.103989+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.104793+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.105469+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: cephadm 2024-09-21T04:55:00.106052+0000 mgr.y (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 5413M 2024-09-21T04:55:01.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.112571+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.115326+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.116189+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: audit 2024-09-21T04:55:00.124138+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[26514]: cluster 2024-09-21T04:55:00.548157+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:54:59.166713+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.074265+0000 mon.c (mon.2) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: cephadm 2024-09-21T04:55:00.091565+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.096493+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.102323+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.103989+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.104793+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.105469+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: cephadm 2024-09-21T04:55:00.106052+0000 mgr.y (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 5413M 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.112571+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.115326+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.116189+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: audit 2024-09-21T04:55:00.124138+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:01 smithi089 bash[19831]: cluster 2024-09-21T04:55:00.548157+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:54:59.166713+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.074265+0000 mon.c (mon.2) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: cephadm 2024-09-21T04:55:00.091565+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.096493+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.102323+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.103989+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.104793+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.105469+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:01.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: cephadm 2024-09-21T04:55:00.106052+0000 mgr.y (mgr.14150) 171 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 5413M 2024-09-21T04:55:01.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.112571+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.115326+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:01.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.116189+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:01.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: audit 2024-09-21T04:55:00.124138+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:01.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:01 smithi110 bash[22020]: cluster 2024-09-21T04:55:00.548157+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:02.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:55:02.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi089:vg_nvme/lv_1 2024-09-21T04:55:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:03 smithi089 bash[26514]: cluster 2024-09-21T04:55:02.548688+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-21T04:55:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:03 smithi089 bash[19831]: cluster 2024-09-21T04:55:02.548688+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-21T04:55:04.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:03 smithi110 bash[22020]: cluster 2024-09-21T04:55:02.548688+0000 mgr.y (mgr.14150) 173 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-21T04:55:06.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:05 smithi089 bash[19831]: cluster 2024-09-21T04:55:04.549262+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T04:55:06.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:05 smithi089 bash[26514]: cluster 2024-09-21T04:55:04.549262+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T04:55:06.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:05 smithi110 bash[22020]: cluster 2024-09-21T04:55:04.549262+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T04:55:07.300 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:55:07.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:07 smithi089 bash[19831]: cluster 2024-09-21T04:55:06.549852+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T04:55:07.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:07 smithi089 bash[26514]: cluster 2024-09-21T04:55:06.549852+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T04:55:08.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:07 smithi110 bash[22020]: cluster 2024-09-21T04:55:06.549852+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[19831]: cluster 2024-09-21T04:55:08.550248+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[19831]: audit 2024-09-21T04:55:08.748489+0000 mgr.y (mgr.14150) 177 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[19831]: audit 2024-09-21T04:55:08.754695+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[19831]: audit 2024-09-21T04:55:08.758682+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[19831]: audit 2024-09-21T04:55:08.760047+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[26514]: cluster 2024-09-21T04:55:08.550248+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[26514]: audit 2024-09-21T04:55:08.748489+0000 mgr.y (mgr.14150) 177 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[26514]: audit 2024-09-21T04:55:08.754695+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:55:10.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[26514]: audit 2024-09-21T04:55:08.758682+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:55:10.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:09 smithi089 bash[26514]: audit 2024-09-21T04:55:08.760047+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:10.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:09 smithi110 bash[22020]: cluster 2024-09-21T04:55:08.550248+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T04:55:10.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:09 smithi110 bash[22020]: audit 2024-09-21T04:55:08.748489+0000 mgr.y (mgr.14150) 177 : audit [DBG] from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:55:10.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:09 smithi110 bash[22020]: audit 2024-09-21T04:55:08.754695+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:55:10.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:09 smithi110 bash[22020]: audit 2024-09-21T04:55:08.758682+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:55:10.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:09 smithi110 bash[22020]: audit 2024-09-21T04:55:08.760047+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:12.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:11 smithi089 bash[19831]: cluster 2024-09-21T04:55:10.550751+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:11 smithi089 bash[26514]: cluster 2024-09-21T04:55:10.550751+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:12.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:11 smithi110 bash[22020]: cluster 2024-09-21T04:55:10.550751+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:13.906 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:13 smithi089 bash[19831]: cluster 2024-09-21T04:55:12.551438+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:13.906 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:13 smithi089 bash[26514]: cluster 2024-09-21T04:55:12.551438+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:13 smithi110 bash[22020]: cluster 2024-09-21T04:55:12.551438+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T04:55:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:15 smithi089 bash[26514]: cluster 2024-09-21T04:55:14.552077+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:15 smithi089 bash[19831]: cluster 2024-09-21T04:55:14.552077+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:16.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:15 smithi110 bash[22020]: cluster 2024-09-21T04:55:14.552077+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[19831]: cluster 2024-09-21T04:55:16.552462+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[19831]: audit 2024-09-21T04:55:17.325459+0000 mon.a (mon.0) 421 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]: dispatch 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[19831]: audit 2024-09-21T04:55:17.327783+0000 mon.a (mon.0) 422 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]': finished 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[19831]: cluster 2024-09-21T04:55:17.333145+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[19831]: audit 2024-09-21T04:55:17.333474+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[26514]: cluster 2024-09-21T04:55:16.552462+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[26514]: audit 2024-09-21T04:55:17.325459+0000 mon.a (mon.0) 421 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]: dispatch 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[26514]: audit 2024-09-21T04:55:17.327783+0000 mon.a (mon.0) 422 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]': finished 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[26514]: cluster 2024-09-21T04:55:17.333145+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-21T04:55:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:17 smithi089 bash[26514]: audit 2024-09-21T04:55:17.333474+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:18.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:17 smithi110 bash[22020]: cluster 2024-09-21T04:55:16.552462+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:17 smithi110 bash[22020]: audit 2024-09-21T04:55:17.325459+0000 mon.a (mon.0) 421 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]: dispatch 2024-09-21T04:55:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:17 smithi110 bash[22020]: audit 2024-09-21T04:55:17.327783+0000 mon.a (mon.0) 422 : audit [INF] from='client.? 172.21.15.89:0/1898056773' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "588e6cd4-48b9-4090-a3bf-1c8e6be3e77e"}]': finished 2024-09-21T04:55:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:17 smithi110 bash[22020]: cluster 2024-09-21T04:55:17.333145+0000 mon.a (mon.0) 423 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-21T04:55:18.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:17 smithi110 bash[22020]: audit 2024-09-21T04:55:17.333474+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:19.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:18 smithi089 bash[19831]: audit 2024-09-21T04:55:17.974085+0000 mon.a (mon.0) 425 : audit [DBG] from='client.? 172.21.15.89:0/3816341691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:55:19.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:18 smithi089 bash[26514]: audit 2024-09-21T04:55:17.974085+0000 mon.a (mon.0) 425 : audit [DBG] from='client.? 172.21.15.89:0/3816341691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:55:19.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:18 smithi110 bash[22020]: audit 2024-09-21T04:55:17.974085+0000 mon.a (mon.0) 425 : audit [DBG] from='client.? 172.21.15.89:0/3816341691' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:55:20.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:19 smithi089 bash[19831]: cluster 2024-09-21T04:55:18.552943+0000 mgr.y (mgr.14150) 182 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:20.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:19 smithi089 bash[26514]: cluster 2024-09-21T04:55:18.552943+0000 mgr.y (mgr.14150) 182 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:20.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:19 smithi110 bash[22020]: cluster 2024-09-21T04:55:18.552943+0000 mgr.y (mgr.14150) 182 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:21.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:21 smithi089 bash[26514]: cluster 2024-09-21T04:55:20.553471+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:21.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:21 smithi089 bash[19831]: cluster 2024-09-21T04:55:20.553471+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:22.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:21 smithi110 bash[22020]: cluster 2024-09-21T04:55:20.553471+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:24.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:23 smithi089 bash[19831]: cluster 2024-09-21T04:55:22.553999+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:24.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:23 smithi089 bash[26514]: cluster 2024-09-21T04:55:22.553999+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:24.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:23 smithi110 bash[22020]: cluster 2024-09-21T04:55:22.553999+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:25 smithi089 bash[26514]: cluster 2024-09-21T04:55:24.554542+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:26.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:25 smithi089 bash[19831]: cluster 2024-09-21T04:55:24.554542+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:26.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:25 smithi110 bash[22020]: cluster 2024-09-21T04:55:24.554542+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:27.947 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:27 smithi089 bash[19831]: cluster 2024-09-21T04:55:26.555024+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:27.947 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:27 smithi089 bash[26514]: cluster 2024-09-21T04:55:26.555024+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:28.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:27 smithi110 bash[22020]: cluster 2024-09-21T04:55:26.555024+0000 mgr.y (mgr.14150) 186 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:29.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:29 smithi089 bash[19831]: cluster 2024-09-21T04:55:28.555519+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:29.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:29 smithi089 bash[26514]: cluster 2024-09-21T04:55:28.555519+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:30.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:29 smithi110 bash[22020]: cluster 2024-09-21T04:55:28.555519+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:31.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:30 smithi089 bash[19831]: audit 2024-09-21T04:55:30.570561+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T04:55:31.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:30 smithi089 bash[19831]: audit 2024-09-21T04:55:30.572207+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:30 smithi089 bash[26514]: audit 2024-09-21T04:55:30.570561+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T04:55:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:30 smithi089 bash[26514]: audit 2024-09-21T04:55:30.572207+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:31.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:30 smithi110 bash[22020]: audit 2024-09-21T04:55:30.570561+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T04:55:31.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:30 smithi110 bash[22020]: audit 2024-09-21T04:55:30.572207+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:31 smithi089 bash[19831]: cluster 2024-09-21T04:55:30.555981+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:31 smithi089 bash[19831]: cephadm 2024-09-21T04:55:30.573738+0000 mgr.y (mgr.14150) 189 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T04:55:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:31 smithi089 bash[26514]: cluster 2024-09-21T04:55:30.555981+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:31 smithi089 bash[26514]: cephadm 2024-09-21T04:55:30.573738+0000 mgr.y (mgr.14150) 189 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T04:55:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:31 smithi110 bash[22020]: cluster 2024-09-21T04:55:30.555981+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:31 smithi110 bash[22020]: cephadm 2024-09-21T04:55:30.573738+0000 mgr.y (mgr.14150) 189 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T04:55:34.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:33 smithi089 bash[26514]: cluster 2024-09-21T04:55:32.556532+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:33 smithi089 bash[19831]: cluster 2024-09-21T04:55:32.556532+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:34.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:33 smithi110 bash[22020]: cluster 2024-09-21T04:55:32.556532+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:35.117 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.117 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.118 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.118 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:55:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.118 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 04:55:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.118 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:55:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.463 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.463 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.463 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.464 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.464 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.464 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 04:55:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:55:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[19831]: cluster 2024-09-21T04:55:34.557147+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[19831]: audit 2024-09-21T04:55:35.378619+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[19831]: audit 2024-09-21T04:55:35.382519+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[19831]: audit 2024-09-21T04:55:35.389209+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[26514]: cluster 2024-09-21T04:55:34.557147+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[26514]: audit 2024-09-21T04:55:35.378619+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[26514]: audit 2024-09-21T04:55:35.382519+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:35 smithi089 bash[26514]: audit 2024-09-21T04:55:35.389209+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:35 smithi110 bash[22020]: cluster 2024-09-21T04:55:34.557147+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:35 smithi110 bash[22020]: audit 2024-09-21T04:55:35.378619+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:35 smithi110 bash[22020]: audit 2024-09-21T04:55:35.382519+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:36.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:35 smithi110 bash[22020]: audit 2024-09-21T04:55:35.389209+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:37.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:37 smithi089 bash[26514]: cluster 2024-09-21T04:55:36.557575+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:37.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:37 smithi089 bash[19831]: cluster 2024-09-21T04:55:36.557575+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:38.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:37 smithi110 bash[22020]: cluster 2024-09-21T04:55:36.557575+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:39 smithi089 bash[19831]: cluster 2024-09-21T04:55:38.558105+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:40.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:39 smithi089 bash[26514]: cluster 2024-09-21T04:55:38.558105+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:39 smithi110 bash[22020]: cluster 2024-09-21T04:55:38.558105+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: cluster 2024-09-21T04:55:40.558633+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: audit 2024-09-21T04:55:41.042618+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: audit 2024-09-21T04:55:41.048974+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: audit 2024-09-21T04:55:41.049887+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: audit 2024-09-21T04:55:41.050597+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[19831]: audit 2024-09-21T04:55:41.055065+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: cluster 2024-09-21T04:55:40.558633+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: audit 2024-09-21T04:55:41.042618+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: audit 2024-09-21T04:55:41.048974+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: audit 2024-09-21T04:55:41.049887+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: audit 2024-09-21T04:55:41.050597+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:42.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:41 smithi089 bash[26514]: audit 2024-09-21T04:55:41.055065+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: cluster 2024-09-21T04:55:40.558633+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: audit 2024-09-21T04:55:41.042618+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: audit 2024-09-21T04:55:41.048974+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: audit 2024-09-21T04:55:41.049887+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: audit 2024-09-21T04:55:41.050597+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:42.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:41 smithi110 bash[22020]: audit 2024-09-21T04:55:41.055065+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:43.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:43 smithi089 bash[19831]: cluster 2024-09-21T04:55:42.559023+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:43.982 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:43 smithi089 bash[26514]: cluster 2024-09-21T04:55:42.559023+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:44.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:43 smithi110 bash[22020]: cluster 2024-09-21T04:55:42.559023+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:44.417 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 3 on host 'smithi089' 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[19831]: audit 2024-09-21T04:55:44.401693+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[19831]: audit 2024-09-21T04:55:44.405794+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[19831]: audit 2024-09-21T04:55:44.412762+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[19831]: audit 2024-09-21T04:55:44.451343+0000 mon.c (mon.2) 10 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[19831]: audit 2024-09-21T04:55:44.451664+0000 mon.a (mon.0) 439 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[26514]: audit 2024-09-21T04:55:44.401693+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[26514]: audit 2024-09-21T04:55:44.405794+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[26514]: audit 2024-09-21T04:55:44.412762+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[26514]: audit 2024-09-21T04:55:44.451343+0000 mon.c (mon.2) 10 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:44 smithi089 bash[26514]: audit 2024-09-21T04:55:44.451664+0000 mon.a (mon.0) 439 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:44 smithi110 bash[22020]: audit 2024-09-21T04:55:44.401693+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:55:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:44 smithi110 bash[22020]: audit 2024-09-21T04:55:44.405794+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:44 smithi110 bash[22020]: audit 2024-09-21T04:55:44.412762+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:44 smithi110 bash[22020]: audit 2024-09-21T04:55:44.451343+0000 mon.c (mon.2) 10 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:44 smithi110 bash[22020]: audit 2024-09-21T04:55:44.451664+0000 mon.a (mon.0) 439 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T04:55:45.065 DEBUG:teuthology.orchestra.run.smithi089:osd.3> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T04:55:45.067 INFO:tasks.cephadm:Deploying osd.4 on smithi110 with /dev/vg_nvme/lv_4... 2024-09-21T04:55:45.067 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T04:55:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: cluster 2024-09-21T04:55:44.559318+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: audit 2024-09-21T04:55:45.412614+0000 mon.a (mon.0) 440 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T04:55:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: cluster 2024-09-21T04:55:45.419804+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-21T04:55:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: audit 2024-09-21T04:55:45.420825+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: audit 2024-09-21T04:55:45.421339+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[19831]: audit 2024-09-21T04:55:45.426647+0000 mon.a (mon.0) 443 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: cluster 2024-09-21T04:55:44.559318+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: audit 2024-09-21T04:55:45.412614+0000 mon.a (mon.0) 440 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: cluster 2024-09-21T04:55:45.419804+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: audit 2024-09-21T04:55:45.420825+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: audit 2024-09-21T04:55:45.421339+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:45 smithi089 bash[26514]: audit 2024-09-21T04:55:45.426647+0000 mon.a (mon.0) 443 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: cluster 2024-09-21T04:55:44.559318+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:46.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: audit 2024-09-21T04:55:45.412614+0000 mon.a (mon.0) 440 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T04:55:46.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: cluster 2024-09-21T04:55:45.419804+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-21T04:55:46.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: audit 2024-09-21T04:55:45.420825+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:46.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: audit 2024-09-21T04:55:45.421339+0000 mon.c (mon.2) 11 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:45 smithi110 bash[22020]: audit 2024-09-21T04:55:45.426647+0000 mon.a (mon.0) 443 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-21T04:55:46.799 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 04:55:46 smithi089 bash[45692]: debug 2024-09-21T04:55:46.460+0000 7f27b5d05640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T04:55:46.799 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 04:55:46 smithi089 bash[45692]: debug 2024-09-21T04:55:46.468+0000 7f27b1b2d640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[19831]: audit 2024-09-21T04:55:46.424328+0000 mon.a (mon.0) 444 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[19831]: cluster 2024-09-21T04:55:46.430055+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[19831]: audit 2024-09-21T04:55:46.430942+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[19831]: audit 2024-09-21T04:55:46.438494+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[19831]: cluster 2024-09-21T04:55:46.559776+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:47.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[26514]: audit 2024-09-21T04:55:46.424328+0000 mon.a (mon.0) 444 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:55:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[26514]: cluster 2024-09-21T04:55:46.430055+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-21T04:55:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[26514]: audit 2024-09-21T04:55:46.430942+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[26514]: audit 2024-09-21T04:55:46.438494+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:47 smithi089 bash[26514]: cluster 2024-09-21T04:55:46.559776+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:47 smithi110 bash[22020]: audit 2024-09-21T04:55:46.424328+0000 mon.a (mon.0) 444 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-21T04:55:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:47 smithi110 bash[22020]: cluster 2024-09-21T04:55:46.430055+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-21T04:55:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:47 smithi110 bash[22020]: audit 2024-09-21T04:55:46.430942+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:47 smithi110 bash[22020]: audit 2024-09-21T04:55:46.438494+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:47.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:47 smithi110 bash[22020]: cluster 2024-09-21T04:55:46.559776+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T04:55:48.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[19831]: cluster 2024-09-21T04:55:45.452161+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:55:48.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[19831]: cluster 2024-09-21T04:55:45.452294+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:55:48.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[19831]: cluster 2024-09-21T04:55:47.429857+0000 mon.a (mon.0) 448 : cluster [INF] osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091] boot 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[19831]: cluster 2024-09-21T04:55:47.429896+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[19831]: audit 2024-09-21T04:55:47.430435+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[26514]: cluster 2024-09-21T04:55:45.452161+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[26514]: cluster 2024-09-21T04:55:45.452294+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[26514]: cluster 2024-09-21T04:55:47.429857+0000 mon.a (mon.0) 448 : cluster [INF] osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091] boot 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[26514]: cluster 2024-09-21T04:55:47.429896+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-21T04:55:48.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:48 smithi089 bash[26514]: audit 2024-09-21T04:55:47.430435+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:48.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:48 smithi110 bash[22020]: cluster 2024-09-21T04:55:45.452161+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:55:48.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:48 smithi110 bash[22020]: cluster 2024-09-21T04:55:45.452294+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:55:48.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:48 smithi110 bash[22020]: cluster 2024-09-21T04:55:47.429857+0000 mon.a (mon.0) 448 : cluster [INF] osd.3 [v2:172.21.15.89:6826/1874825091,v1:172.21.15.89:6827/1874825091] boot 2024-09-21T04:55:48.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:48 smithi110 bash[22020]: cluster 2024-09-21T04:55:47.429896+0000 mon.a (mon.0) 449 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-21T04:55:48.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:48 smithi110 bash[22020]: audit 2024-09-21T04:55:47.430435+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T04:55:49.788 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:55:49.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:49 smithi089 bash[19831]: cluster 2024-09-21T04:55:48.446617+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-21T04:55:49.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:49 smithi089 bash[19831]: cluster 2024-09-21T04:55:48.560292+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:49.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:49 smithi089 bash[26514]: cluster 2024-09-21T04:55:48.446617+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-21T04:55:49.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:49 smithi089 bash[26514]: cluster 2024-09-21T04:55:48.560292+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:49.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:49 smithi110 bash[22020]: cluster 2024-09-21T04:55:48.446617+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-21T04:55:49.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:49 smithi110 bash[22020]: cluster 2024-09-21T04:55:48.560292+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:51.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:51 smithi089 bash[19831]: cluster 2024-09-21T04:55:50.560714+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:51.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:51 smithi089 bash[26514]: cluster 2024-09-21T04:55:50.560714+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:52.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:51 smithi110 bash[22020]: cluster 2024-09-21T04:55:50.560714+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-09-21T04:55:53.679 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:55:53.729 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-09-21T04:55:53.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:53 smithi089 bash[19831]: cluster 2024-09-21T04:55:52.561293+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:53.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:53 smithi089 bash[26514]: cluster 2024-09-21T04:55:52.561293+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:54.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:53 smithi110 bash[22020]: cluster 2024-09-21T04:55:52.561293+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:55.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: cephadm 2024-09-21T04:55:54.124296+0000 mgr.y (mgr.14150) 201 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.133780+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.144745+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.147821+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.149643+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.151630+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.153433+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: cephadm 2024-09-21T04:55:54.154855+0000 mgr.y (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 4060M 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.163725+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.168936+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:55.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.170828+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: audit 2024-09-21T04:55:54.182726+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[19831]: cluster 2024-09-21T04:55:54.561846+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: cephadm 2024-09-21T04:55:54.124296+0000 mgr.y (mgr.14150) 201 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.133780+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.144745+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.147821+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.149643+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.151630+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.153433+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: cephadm 2024-09-21T04:55:54.154855+0000 mgr.y (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 4060M 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.163725+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.168936+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:55.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.170828+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:55.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: audit 2024-09-21T04:55:54.182726+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.552 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:55 smithi089 bash[26514]: cluster 2024-09-21T04:55:54.561846+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: cephadm 2024-09-21T04:55:54.124296+0000 mgr.y (mgr.14150) 201 : cephadm [INF] Detected new or changed devices on smithi089 2024-09-21T04:55:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.133780+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.144745+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.147821+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.149643+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.151630+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.153433+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: cephadm 2024-09-21T04:55:54.154855+0000 mgr.y (mgr.14150) 202 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 4060M 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.163725+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.168936+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.170828+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: audit 2024-09-21T04:55:54.182726+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:55:55.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:55 smithi110 bash[22020]: cluster 2024-09-21T04:55:54.561846+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:58.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:57 smithi089 bash[19831]: cluster 2024-09-21T04:55:56.562353+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:57 smithi089 bash[26514]: cluster 2024-09-21T04:55:56.562353+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:58.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:57 smithi110 bash[22020]: cluster 2024-09-21T04:55:56.562353+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:55:58.453 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:55:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:55:59 smithi110 bash[22020]: cluster 2024-09-21T04:55:58.562912+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:00.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:55:59 smithi089 bash[19831]: cluster 2024-09-21T04:55:58.562912+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:00.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:55:59 smithi089 bash[26514]: cluster 2024-09-21T04:55:58.562912+0000 mgr.y (mgr.14150) 205 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[26514]: audit 2024-09-21T04:55:59.821494+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[26514]: audit 2024-09-21T04:55:59.827518+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[26514]: audit 2024-09-21T04:55:59.829119+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[19831]: audit 2024-09-21T04:55:59.821494+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[19831]: audit 2024-09-21T04:55:59.827518+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:01.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:00 smithi089 bash[19831]: audit 2024-09-21T04:55:59.829119+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:00 smithi110 bash[22020]: audit 2024-09-21T04:55:59.821494+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:00 smithi110 bash[22020]: audit 2024-09-21T04:55:59.827518+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:00 smithi110 bash[22020]: audit 2024-09-21T04:55:59.829119+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:01 smithi089 bash[26514]: audit 2024-09-21T04:55:59.814726+0000 mgr.y (mgr.14150) 206 : audit [DBG] from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:02.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:01 smithi089 bash[26514]: cluster 2024-09-21T04:56:00.563551+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:01 smithi089 bash[19831]: audit 2024-09-21T04:55:59.814726+0000 mgr.y (mgr.14150) 206 : audit [DBG] from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:01 smithi089 bash[19831]: cluster 2024-09-21T04:56:00.563551+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:02.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:01 smithi110 bash[22020]: audit 2024-09-21T04:55:59.814726+0000 mgr.y (mgr.14150) 206 : audit [DBG] from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:02.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:01 smithi110 bash[22020]: cluster 2024-09-21T04:56:00.563551+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:03 smithi089 bash[26514]: cluster 2024-09-21T04:56:02.564226+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:03 smithi089 bash[19831]: cluster 2024-09-21T04:56:02.564226+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:04.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:03 smithi110 bash[22020]: cluster 2024-09-21T04:56:02.564226+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:05.926 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:05 smithi110 bash[22020]: cluster 2024-09-21T04:56:04.564900+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:06.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:05 smithi089 bash[26514]: cluster 2024-09-21T04:56:04.564900+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:06.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:05 smithi089 bash[19831]: cluster 2024-09-21T04:56:04.564900+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:08.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:07 smithi089 bash[26514]: cluster 2024-09-21T04:56:06.565564+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:08.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:07 smithi089 bash[19831]: cluster 2024-09-21T04:56:06.565564+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:08.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:07 smithi110 bash[22020]: cluster 2024-09-21T04:56:06.565564+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[19831]: audit 2024-09-21T04:56:08.398001+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[19831]: audit 2024-09-21T04:56:08.398020+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.110:0/1699946888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[19831]: audit 2024-09-21T04:56:08.401473+0000 mon.a (mon.0) 466 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]': finished 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[19831]: cluster 2024-09-21T04:56:08.406918+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[19831]: audit 2024-09-21T04:56:08.407311+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:09.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[26514]: audit 2024-09-21T04:56:08.398001+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[26514]: audit 2024-09-21T04:56:08.398020+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.110:0/1699946888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[26514]: audit 2024-09-21T04:56:08.401473+0000 mon.a (mon.0) 466 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]': finished 2024-09-21T04:56:09.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[26514]: cluster 2024-09-21T04:56:08.406918+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-21T04:56:09.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:08 smithi089 bash[26514]: audit 2024-09-21T04:56:08.407311+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:09.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:08 smithi110 bash[22020]: audit 2024-09-21T04:56:08.398001+0000 mon.a (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:08 smithi110 bash[22020]: audit 2024-09-21T04:56:08.398020+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.110:0/1699946888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]: dispatch 2024-09-21T04:56:09.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:08 smithi110 bash[22020]: audit 2024-09-21T04:56:08.401473+0000 mon.a (mon.0) 466 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9"}]': finished 2024-09-21T04:56:09.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:08 smithi110 bash[22020]: cluster 2024-09-21T04:56:08.406918+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-21T04:56:09.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:08 smithi110 bash[22020]: audit 2024-09-21T04:56:08.407311+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:09 smithi089 bash[19831]: cluster 2024-09-21T04:56:08.566095+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:10.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:09 smithi089 bash[19831]: audit 2024-09-21T04:56:09.060174+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.110:0/3474647927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:56:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:09 smithi089 bash[26514]: cluster 2024-09-21T04:56:08.566095+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:09 smithi089 bash[26514]: audit 2024-09-21T04:56:09.060174+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.110:0/3474647927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:56:10.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:09 smithi110 bash[22020]: cluster 2024-09-21T04:56:08.566095+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:10.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:09 smithi110 bash[22020]: audit 2024-09-21T04:56:09.060174+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.110:0/3474647927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:56:12.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:11 smithi089 bash[19831]: cluster 2024-09-21T04:56:10.566623+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:11 smithi089 bash[26514]: cluster 2024-09-21T04:56:10.566623+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:11 smithi110 bash[22020]: cluster 2024-09-21T04:56:10.566623+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:13 smithi089 bash[19831]: cluster 2024-09-21T04:56:12.567211+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:13 smithi089 bash[26514]: cluster 2024-09-21T04:56:12.567211+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:13 smithi110 bash[22020]: cluster 2024-09-21T04:56:12.567211+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:15 smithi089 bash[19831]: cluster 2024-09-21T04:56:14.567772+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:15 smithi089 bash[26514]: cluster 2024-09-21T04:56:14.567772+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:16.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:15 smithi110 bash[22020]: cluster 2024-09-21T04:56:14.567772+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:18.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:17 smithi089 bash[19831]: cluster 2024-09-21T04:56:16.568395+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:18.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:17 smithi089 bash[26514]: cluster 2024-09-21T04:56:16.568395+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:18.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:17 smithi110 bash[22020]: cluster 2024-09-21T04:56:16.568395+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:20.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:19 smithi089 bash[19831]: cluster 2024-09-21T04:56:18.569005+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:20.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:19 smithi089 bash[26514]: cluster 2024-09-21T04:56:18.569005+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:20.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:19 smithi110 bash[22020]: cluster 2024-09-21T04:56:18.569005+0000 mgr.y (mgr.14150) 216 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:21 smithi089 bash[19831]: cluster 2024-09-21T04:56:20.569531+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:21 smithi089 bash[26514]: cluster 2024-09-21T04:56:20.569531+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:22.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:21 smithi110 bash[22020]: cluster 2024-09-21T04:56:20.569531+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[19831]: audit 2024-09-21T04:56:21.715236+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[19831]: audit 2024-09-21T04:56:21.717206+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[19831]: cephadm 2024-09-21T04:56:21.718932+0000 mgr.y (mgr.14150) 218 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[26514]: audit 2024-09-21T04:56:21.715236+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[26514]: audit 2024-09-21T04:56:21.717206+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:23.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:22 smithi089 bash[26514]: cephadm 2024-09-21T04:56:21.718932+0000 mgr.y (mgr.14150) 218 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T04:56:23.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:22 smithi110 bash[22020]: audit 2024-09-21T04:56:21.715236+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T04:56:23.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:22 smithi110 bash[22020]: audit 2024-09-21T04:56:21.717206+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:23.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:22 smithi110 bash[22020]: cephadm 2024-09-21T04:56:21.718932+0000 mgr.y (mgr.14150) 218 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T04:56:24.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:23 smithi089 bash[26514]: cluster 2024-09-21T04:56:22.570097+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:24.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:23 smithi089 bash[19831]: cluster 2024-09-21T04:56:22.570097+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:24.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:23 smithi110 bash[22020]: cluster 2024-09-21T04:56:22.570097+0000 mgr.y (mgr.14150) 219 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:26.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:25 smithi089 bash[19831]: cluster 2024-09-21T04:56:24.570651+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:25 smithi089 bash[26514]: cluster 2024-09-21T04:56:24.570651+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:26.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:25 smithi110 bash[22020]: cluster 2024-09-21T04:56:24.570651+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:26.394 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:56:26 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:56:26.394 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:26 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:56:26.704 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:26 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:56:26.704 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:56:26 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[19831]: audit 2024-09-21T04:56:26.660899+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[19831]: audit 2024-09-21T04:56:26.668304+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[19831]: audit 2024-09-21T04:56:26.678575+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[26514]: audit 2024-09-21T04:56:26.660899+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[26514]: audit 2024-09-21T04:56:26.668304+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:26 smithi089 bash[26514]: audit 2024-09-21T04:56:26.678575+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:27.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:26 smithi110 bash[22020]: audit 2024-09-21T04:56:26.660899+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:27.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:26 smithi110 bash[22020]: audit 2024-09-21T04:56:26.668304+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:27.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:26 smithi110 bash[22020]: audit 2024-09-21T04:56:26.678575+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:27 smithi089 bash[19831]: cluster 2024-09-21T04:56:26.571208+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:27 smithi089 bash[26514]: cluster 2024-09-21T04:56:26.571208+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:28.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:27 smithi110 bash[22020]: cluster 2024-09-21T04:56:26.571208+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:29.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:29 smithi110 bash[22020]: cluster 2024-09-21T04:56:28.571871+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:30.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:29 smithi089 bash[19831]: cluster 2024-09-21T04:56:28.571871+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:29 smithi089 bash[26514]: cluster 2024-09-21T04:56:28.571871+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:31 smithi089 bash[19831]: cluster 2024-09-21T04:56:30.572433+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:31 smithi089 bash[26514]: cluster 2024-09-21T04:56:30.572433+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:32.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:31 smithi110 bash[22020]: cluster 2024-09-21T04:56:30.572433+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: cluster 2024-09-21T04:56:32.572979+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: audit 2024-09-21T04:56:33.008632+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: audit 2024-09-21T04:56:33.018495+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: audit 2024-09-21T04:56:33.020318+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: audit 2024-09-21T04:56:33.022280+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:33.985 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:33 smithi110 bash[22020]: audit 2024-09-21T04:56:33.033870+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: cluster 2024-09-21T04:56:32.572979+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: audit 2024-09-21T04:56:33.008632+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: audit 2024-09-21T04:56:33.018495+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: audit 2024-09-21T04:56:33.020318+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: audit 2024-09-21T04:56:33.022280+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:34.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[19831]: audit 2024-09-21T04:56:33.033870+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: cluster 2024-09-21T04:56:32.572979+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:34.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: audit 2024-09-21T04:56:33.008632+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: audit 2024-09-21T04:56:33.018495+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:34.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: audit 2024-09-21T04:56:33.020318+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:34.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: audit 2024-09-21T04:56:33.022280+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:34.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:33 smithi089 bash[26514]: audit 2024-09-21T04:56:33.033870+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:35.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:35 smithi110 bash[22020]: cluster 2024-09-21T04:56:34.573504+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:36.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:35 smithi089 bash[19831]: cluster 2024-09-21T04:56:34.573504+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:35 smithi089 bash[26514]: cluster 2024-09-21T04:56:34.573504+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:36.983 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:36 smithi110 bash[22020]: audit 2024-09-21T04:56:35.757553+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:36.984 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:36 smithi110 bash[22020]: audit 2024-09-21T04:56:35.757958+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:37.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:36 smithi089 bash[19831]: audit 2024-09-21T04:56:35.757553+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:37.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:36 smithi089 bash[19831]: audit 2024-09-21T04:56:35.757958+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:37.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:36 smithi089 bash[26514]: audit 2024-09-21T04:56:35.757553+0000 mon.a (mon.0) 479 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:37.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:36 smithi089 bash[26514]: audit 2024-09-21T04:56:35.757958+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T04:56:37.483 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 4 on host 'smithi110' 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: cluster 2024-09-21T04:56:36.573990+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:36.729801+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:36.734728+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: cluster 2024-09-21T04:56:36.738008+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:36.738669+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:37.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:36.739591+0000 mon.a (mon.0) 483 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:37.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:37.460800+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:37.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:37.468575+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:37.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:37 smithi110 bash[22020]: audit 2024-09-21T04:56:37.476632+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: cluster 2024-09-21T04:56:36.573990+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:36.729801+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:36.734728+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: cluster 2024-09-21T04:56:36.738008+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:36.738669+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:38.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:36.739591+0000 mon.a (mon.0) 483 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:37.460800+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:37.468575+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[19831]: audit 2024-09-21T04:56:37.476632+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: cluster 2024-09-21T04:56:36.573990+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:36.729801+0000 mon.a (mon.0) 480 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:36.734728+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: cluster 2024-09-21T04:56:36.738008+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:36.738669+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:38.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:36.739591+0000 mon.a (mon.0) 483 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:56:38.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:37.460800+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:56:38.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:37.468575+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:38.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:37 smithi089 bash[26514]: audit 2024-09-21T04:56:37.476632+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:38.077 DEBUG:teuthology.orchestra.run.smithi110:osd.4> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T04:56:38.079 INFO:tasks.cephadm:Deploying osd.5 on smithi110 with /dev/vg_nvme/lv_3... 2024-09-21T04:56:38.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[19831]: audit 2024-09-21T04:56:37.732176+0000 mon.a (mon.0) 487 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[19831]: cluster 2024-09-21T04:56:37.738642+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[19831]: audit 2024-09-21T04:56:37.739870+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[19831]: audit 2024-09-21T04:56:37.749284+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[19831]: audit 2024-09-21T04:56:38.053654+0000 mon.a (mon.0) 491 : audit [INF] from='osd.4 ' entity='osd.4' 2024-09-21T04:56:39.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[26514]: audit 2024-09-21T04:56:37.732176+0000 mon.a (mon.0) 487 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:56:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[26514]: cluster 2024-09-21T04:56:37.738642+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-21T04:56:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[26514]: audit 2024-09-21T04:56:37.739870+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[26514]: audit 2024-09-21T04:56:37.749284+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:38 smithi089 bash[26514]: audit 2024-09-21T04:56:38.053654+0000 mon.a (mon.0) 491 : audit [INF] from='osd.4 ' entity='osd.4' 2024-09-21T04:56:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:38 smithi110 bash[22020]: audit 2024-09-21T04:56:37.732176+0000 mon.a (mon.0) 487 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:56:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:38 smithi110 bash[22020]: cluster 2024-09-21T04:56:37.738642+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-21T04:56:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:38 smithi110 bash[22020]: audit 2024-09-21T04:56:37.739870+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:38 smithi110 bash[22020]: audit 2024-09-21T04:56:37.749284+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:38 smithi110 bash[22020]: audit 2024-09-21T04:56:38.053654+0000 mon.a (mon.0) 491 : audit [INF] from='osd.4 ' entity='osd.4' 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: cluster 2024-09-21T04:56:36.706923+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: cluster 2024-09-21T04:56:36.706998+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: cluster 2024-09-21T04:56:38.574511+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: audit 2024-09-21T04:56:38.750339+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: cluster 2024-09-21T04:56:38.759080+0000 mon.a (mon.0) 493 : cluster [INF] osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539] boot 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: cluster 2024-09-21T04:56:38.759163+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-21T04:56:40.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[19831]: audit 2024-09-21T04:56:38.759637+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: cluster 2024-09-21T04:56:36.706923+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: cluster 2024-09-21T04:56:36.706998+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: cluster 2024-09-21T04:56:38.574511+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: audit 2024-09-21T04:56:38.750339+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: cluster 2024-09-21T04:56:38.759080+0000 mon.a (mon.0) 493 : cluster [INF] osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539] boot 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: cluster 2024-09-21T04:56:38.759163+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-21T04:56:40.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:39 smithi089 bash[26514]: audit 2024-09-21T04:56:38.759637+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: cluster 2024-09-21T04:56:36.706923+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: cluster 2024-09-21T04:56:36.706998+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: cluster 2024-09-21T04:56:38.574511+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: audit 2024-09-21T04:56:38.750339+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: cluster 2024-09-21T04:56:38.759080+0000 mon.a (mon.0) 493 : cluster [INF] osd.4 [v2:172.21.15.110:6800/2769401539,v1:172.21.15.110:6801/2769401539] boot 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: cluster 2024-09-21T04:56:38.759163+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-21T04:56:40.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:39 smithi110 bash[22020]: audit 2024-09-21T04:56:38.759637+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T04:56:41.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:40 smithi089 bash[19831]: cluster 2024-09-21T04:56:39.760068+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-21T04:56:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:40 smithi089 bash[26514]: cluster 2024-09-21T04:56:39.760068+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-21T04:56:41.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:40 smithi110 bash[22020]: cluster 2024-09-21T04:56:39.760068+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-21T04:56:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:41 smithi089 bash[19831]: cluster 2024-09-21T04:56:40.575037+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:41 smithi089 bash[19831]: cluster 2024-09-21T04:56:40.773373+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-21T04:56:42.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:41 smithi089 bash[26514]: cluster 2024-09-21T04:56:40.575037+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:42.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:41 smithi089 bash[26514]: cluster 2024-09-21T04:56:40.773373+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-21T04:56:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:41 smithi110 bash[22020]: cluster 2024-09-21T04:56:40.575037+0000 mgr.y (mgr.14150) 228 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:42.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:41 smithi110 bash[22020]: cluster 2024-09-21T04:56:40.773373+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-21T04:56:42.851 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:56:43.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:42 smithi110 bash[22020]: cluster 2024-09-21T04:56:41.774023+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-21T04:56:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:42 smithi089 bash[19831]: cluster 2024-09-21T04:56:41.774023+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-21T04:56:43.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:42 smithi089 bash[26514]: cluster 2024-09-21T04:56:41.774023+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-21T04:56:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:43 smithi089 bash[19831]: cluster 2024-09-21T04:56:42.575604+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:56:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:43 smithi089 bash[19831]: cluster 2024-09-21T04:56:42.800669+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-21T04:56:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:43 smithi089 bash[26514]: cluster 2024-09-21T04:56:42.575604+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:56:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:43 smithi089 bash[26514]: cluster 2024-09-21T04:56:42.800669+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:43 smithi110 bash[22020]: cluster 2024-09-21T04:56:42.575604+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:56:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:43 smithi110 bash[22020]: cluster 2024-09-21T04:56:42.800669+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e35: 5 total, 5 up, 5 in 2024-09-21T04:56:44.799 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 04:56:44 smithi089 bash[20084]: debug 2024-09-21T04:56:44.531+0000 7fcd3bce9640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-21T04:56:46.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:45 smithi089 bash[19831]: cluster 2024-09-21T04:56:44.576134+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:56:46.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:45 smithi089 bash[26514]: cluster 2024-09-21T04:56:44.576134+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:56:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:45 smithi110 bash[22020]: cluster 2024-09-21T04:56:44.576134+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v205: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:56:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:56:47.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-09-21T04:56:48.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:47 smithi110 bash[22020]: cluster 2024-09-21T04:56:46.576699+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:56:48.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:47 smithi089 bash[19831]: cluster 2024-09-21T04:56:46.576699+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:56:48.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:47 smithi089 bash[26514]: cluster 2024-09-21T04:56:46.576699+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:56:50.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:49 smithi089 bash[26514]: cluster 2024-09-21T04:56:48.577295+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:56:50.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:49 smithi089 bash[19831]: cluster 2024-09-21T04:56:48.577295+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:56:50.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:49 smithi110 bash[22020]: cluster 2024-09-21T04:56:48.577295+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:56:51.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: cephadm 2024-09-21T04:56:50.064897+0000 mgr.y (mgr.14150) 233 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.073151+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.081476+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.084152+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: cephadm 2024-09-21T04:56:50.085540+0000 mgr.y (mgr.14150) 234 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 17265M 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.091910+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.095929+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.097497+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: audit 2024-09-21T04:56:50.106915+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[19831]: cluster 2024-09-21T04:56:50.577857+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:51.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: cephadm 2024-09-21T04:56:50.064897+0000 mgr.y (mgr.14150) 233 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.073151+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.081476+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.084152+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: cephadm 2024-09-21T04:56:50.085540+0000 mgr.y (mgr.14150) 234 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 17265M 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.091910+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.095929+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.097497+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: audit 2024-09-21T04:56:50.106915+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.551 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:51 smithi089 bash[26514]: cluster 2024-09-21T04:56:50.577857+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: cephadm 2024-09-21T04:56:50.064897+0000 mgr.y (mgr.14150) 233 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.073151+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.081476+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.084152+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: cephadm 2024-09-21T04:56:50.085540+0000 mgr.y (mgr.14150) 234 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 17265M 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.091910+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.095929+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.097497+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: audit 2024-09-21T04:56:50.106915+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:56:51.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:51 smithi110 bash[22020]: cluster 2024-09-21T04:56:50.577857+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:52.519 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:56:53.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:53 smithi110 bash[22020]: cluster 2024-09-21T04:56:52.578409+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:54.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:53 smithi089 bash[19831]: cluster 2024-09-21T04:56:52.578409+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:54.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:53 smithi089 bash[26514]: cluster 2024-09-21T04:56:52.578409+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[19831]: audit 2024-09-21T04:56:53.791653+0000 mgr.y (mgr.14150) 237 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[19831]: audit 2024-09-21T04:56:53.798020+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[19831]: audit 2024-09-21T04:56:53.803910+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:55.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[19831]: audit 2024-09-21T04:56:53.805663+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:55.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[26514]: audit 2024-09-21T04:56:53.791653+0000 mgr.y (mgr.14150) 237 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[26514]: audit 2024-09-21T04:56:53.798020+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[26514]: audit 2024-09-21T04:56:53.803910+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:55.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:54 smithi089 bash[26514]: audit 2024-09-21T04:56:53.805663+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:55.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:54 smithi110 bash[22020]: audit 2024-09-21T04:56:53.791653+0000 mgr.y (mgr.14150) 237 : audit [DBG] from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:56:55.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:54 smithi110 bash[22020]: audit 2024-09-21T04:56:53.798020+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:56:55.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:54 smithi110 bash[22020]: audit 2024-09-21T04:56:53.803910+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:56:55.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:54 smithi110 bash[22020]: audit 2024-09-21T04:56:53.805663+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:56:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:55 smithi089 bash[19831]: cluster 2024-09-21T04:56:54.578940+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:55 smithi089 bash[26514]: cluster 2024-09-21T04:56:54.578940+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:55 smithi110 bash[22020]: cluster 2024-09-21T04:56:54.578940+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:58.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:57 smithi089 bash[19831]: cluster 2024-09-21T04:56:56.579484+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:57 smithi089 bash[26514]: cluster 2024-09-21T04:56:56.579484+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:58.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:57 smithi110 bash[22020]: cluster 2024-09-21T04:56:56.579484+0000 mgr.y (mgr.14150) 239 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:56:59.953 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:56:59 smithi110 bash[22020]: cluster 2024-09-21T04:56:58.580046+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:00.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:56:59 smithi089 bash[19831]: cluster 2024-09-21T04:56:58.580046+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:00.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:56:59 smithi089 bash[26514]: cluster 2024-09-21T04:56:58.580046+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:01.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:01 smithi110 bash[22020]: cluster 2024-09-21T04:57:00.580673+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:01 smithi089 bash[26514]: cluster 2024-09-21T04:57:00.580673+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:02.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:01 smithi089 bash[19831]: cluster 2024-09-21T04:57:00.580673+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[19831]: audit 2024-09-21T04:57:02.200170+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[19831]: audit 2024-09-21T04:57:02.200576+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.110:0/1399228599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[19831]: audit 2024-09-21T04:57:02.203527+0000 mon.a (mon.0) 511 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]': finished 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[19831]: cluster 2024-09-21T04:57:02.208776+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[19831]: audit 2024-09-21T04:57:02.209318+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[26514]: audit 2024-09-21T04:57:02.200170+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[26514]: audit 2024-09-21T04:57:02.200576+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.110:0/1399228599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[26514]: audit 2024-09-21T04:57:02.203527+0000 mon.a (mon.0) 511 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]': finished 2024-09-21T04:57:03.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[26514]: cluster 2024-09-21T04:57:02.208776+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-21T04:57:03.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:02 smithi089 bash[26514]: audit 2024-09-21T04:57:02.209318+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:02 smithi110 bash[22020]: audit 2024-09-21T04:57:02.200170+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:02 smithi110 bash[22020]: audit 2024-09-21T04:57:02.200576+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.110:0/1399228599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]: dispatch 2024-09-21T04:57:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:02 smithi110 bash[22020]: audit 2024-09-21T04:57:02.203527+0000 mon.a (mon.0) 511 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "860b7538-f4da-4353-b0be-8d8d582f6225"}]': finished 2024-09-21T04:57:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:02 smithi110 bash[22020]: cluster 2024-09-21T04:57:02.208776+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-21T04:57:03.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:02 smithi110 bash[22020]: audit 2024-09-21T04:57:02.209318+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:04.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:03 smithi089 bash[19831]: cluster 2024-09-21T04:57:02.581238+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:04.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:03 smithi089 bash[19831]: audit 2024-09-21T04:57:02.862542+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.110:0/844169559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:03 smithi089 bash[26514]: cluster 2024-09-21T04:57:02.581238+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:04.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:03 smithi089 bash[26514]: audit 2024-09-21T04:57:02.862542+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.110:0/844169559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:03 smithi110 bash[22020]: cluster 2024-09-21T04:57:02.581238+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:03 smithi110 bash[22020]: audit 2024-09-21T04:57:02.862542+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.110:0/844169559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:06.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:05 smithi089 bash[19831]: cluster 2024-09-21T04:57:04.581789+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:06.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:05 smithi089 bash[26514]: cluster 2024-09-21T04:57:04.581789+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:05 smithi110 bash[22020]: cluster 2024-09-21T04:57:04.581789+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:08.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:07 smithi089 bash[19831]: cluster 2024-09-21T04:57:06.582422+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:08.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:07 smithi089 bash[26514]: cluster 2024-09-21T04:57:06.582422+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:08.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:07 smithi110 bash[22020]: cluster 2024-09-21T04:57:06.582422+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:10.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:09 smithi089 bash[19831]: cluster 2024-09-21T04:57:08.583071+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:10.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:09 smithi089 bash[26514]: cluster 2024-09-21T04:57:08.583071+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:10.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:09 smithi110 bash[22020]: cluster 2024-09-21T04:57:08.583071+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:12.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:11 smithi089 bash[19831]: cluster 2024-09-21T04:57:10.583728+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:12.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:11 smithi089 bash[26514]: cluster 2024-09-21T04:57:10.583728+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:11 smithi110 bash[22020]: cluster 2024-09-21T04:57:10.583728+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:13 smithi089 bash[19831]: cluster 2024-09-21T04:57:12.584382+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:13 smithi089 bash[26514]: cluster 2024-09-21T04:57:12.584382+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:13 smithi110 bash[22020]: cluster 2024-09-21T04:57:12.584382+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[19831]: cluster 2024-09-21T04:57:14.584943+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[19831]: audit 2024-09-21T04:57:15.681352+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T04:57:16.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[19831]: audit 2024-09-21T04:57:15.682978+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[26514]: cluster 2024-09-21T04:57:14.584943+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[26514]: audit 2024-09-21T04:57:15.681352+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T04:57:16.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:15 smithi089 bash[26514]: audit 2024-09-21T04:57:15.682978+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:16.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:15 smithi110 bash[22020]: cluster 2024-09-21T04:57:14.584943+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:16.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:15 smithi110 bash[22020]: audit 2024-09-21T04:57:15.681352+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T04:57:16.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:15 smithi110 bash[22020]: audit 2024-09-21T04:57:15.682978+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:16 smithi089 bash[19831]: cephadm 2024-09-21T04:57:15.684479+0000 mgr.y (mgr.14150) 249 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T04:57:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:16 smithi089 bash[26514]: cephadm 2024-09-21T04:57:15.684479+0000 mgr.y (mgr.14150) 249 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T04:57:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:16 smithi110 bash[22020]: cephadm 2024-09-21T04:57:15.684479+0000 mgr.y (mgr.14150) 249 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T04:57:17.979 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:17 smithi110 bash[22020]: cluster 2024-09-21T04:57:16.585482+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:17 smithi089 bash[19831]: cluster 2024-09-21T04:57:16.585482+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:17 smithi089 bash[26514]: cluster 2024-09-21T04:57:16.585482+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:20.000 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:19 smithi110 bash[22020]: cluster 2024-09-21T04:57:18.586025+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:19 smithi089 bash[19831]: cluster 2024-09-21T04:57:18.586025+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:20.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:19 smithi089 bash[26514]: cluster 2024-09-21T04:57:18.586025+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:20.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:20.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:20.306 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:20.306 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:20.306 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:20.306 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:57:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[19831]: audit 2024-09-21T04:57:20.380820+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[19831]: audit 2024-09-21T04:57:20.388279+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[19831]: audit 2024-09-21T04:57:20.398172+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[26514]: audit 2024-09-21T04:57:20.380820+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[26514]: audit 2024-09-21T04:57:20.388279+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:21.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:20 smithi089 bash[26514]: audit 2024-09-21T04:57:20.398172+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:20 smithi110 bash[22020]: audit 2024-09-21T04:57:20.380820+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:20 smithi110 bash[22020]: audit 2024-09-21T04:57:20.388279+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:20 smithi110 bash[22020]: audit 2024-09-21T04:57:20.398172+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:21 smithi089 bash[19831]: cluster 2024-09-21T04:57:20.586580+0000 mgr.y (mgr.14150) 252 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:22.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:21 smithi089 bash[26514]: cluster 2024-09-21T04:57:20.586580+0000 mgr.y (mgr.14150) 252 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:21 smithi110 bash[22020]: cluster 2024-09-21T04:57:20.586580+0000 mgr.y (mgr.14150) 252 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:24.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:23 smithi089 bash[19831]: cluster 2024-09-21T04:57:22.587103+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:24.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:23 smithi089 bash[26514]: cluster 2024-09-21T04:57:22.587103+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:24.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:23 smithi110 bash[22020]: cluster 2024-09-21T04:57:22.587103+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:25 smithi089 bash[19831]: cluster 2024-09-21T04:57:24.587614+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:26.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:25 smithi089 bash[26514]: cluster 2024-09-21T04:57:24.587614+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:26.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:25 smithi110 bash[22020]: cluster 2024-09-21T04:57:24.587614+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:28.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: cluster 2024-09-21T04:57:26.588248+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:28.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: audit 2024-09-21T04:57:26.732081+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: audit 2024-09-21T04:57:26.744234+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: audit 2024-09-21T04:57:26.746397+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: audit 2024-09-21T04:57:26.748371+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[19831]: audit 2024-09-21T04:57:26.762351+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: cluster 2024-09-21T04:57:26.588248+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: audit 2024-09-21T04:57:26.732081+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: audit 2024-09-21T04:57:26.744234+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: audit 2024-09-21T04:57:26.746397+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: audit 2024-09-21T04:57:26.748371+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:28.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:27 smithi089 bash[26514]: audit 2024-09-21T04:57:26.762351+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: cluster 2024-09-21T04:57:26.588248+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: audit 2024-09-21T04:57:26.732081+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: audit 2024-09-21T04:57:26.744234+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: audit 2024-09-21T04:57:26.746397+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: audit 2024-09-21T04:57:26.748371+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:28.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:27 smithi110 bash[22020]: audit 2024-09-21T04:57:26.762351+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:29.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:29 smithi110 bash[22020]: cluster 2024-09-21T04:57:28.588813+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:29.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:29 smithi110 bash[22020]: audit 2024-09-21T04:57:29.503419+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:29.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:29 smithi110 bash[22020]: audit 2024-09-21T04:57:29.503775+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[26514]: cluster 2024-09-21T04:57:28.588813+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[26514]: audit 2024-09-21T04:57:29.503419+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[26514]: audit 2024-09-21T04:57:29.503775+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:30.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[19831]: cluster 2024-09-21T04:57:28.588813+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:30.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[19831]: audit 2024-09-21T04:57:29.503419+0000 mon.a (mon.0) 524 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:30.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:29 smithi089 bash[19831]: audit 2024-09-21T04:57:29.503775+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T04:57:30.867 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 5 on host 'smithi110' 2024-09-21T04:57:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[19831]: audit 2024-09-21T04:57:29.732995+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T04:57:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[19831]: audit 2024-09-21T04:57:29.737762+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[19831]: cluster 2024-09-21T04:57:29.740741+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[19831]: audit 2024-09-21T04:57:29.742141+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[19831]: audit 2024-09-21T04:57:29.748823+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[26514]: audit 2024-09-21T04:57:29.732995+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[26514]: audit 2024-09-21T04:57:29.737762+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[26514]: cluster 2024-09-21T04:57:29.740741+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[26514]: audit 2024-09-21T04:57:29.742141+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:30 smithi089 bash[26514]: audit 2024-09-21T04:57:29.748823+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:30 smithi110 bash[22020]: audit 2024-09-21T04:57:29.732995+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T04:57:31.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:30 smithi110 bash[22020]: audit 2024-09-21T04:57:29.737762+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:30 smithi110 bash[22020]: cluster 2024-09-21T04:57:29.740741+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-21T04:57:31.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:30 smithi110 bash[22020]: audit 2024-09-21T04:57:29.742141+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:31.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:30 smithi110 bash[22020]: audit 2024-09-21T04:57:29.748823+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:57:31.444 DEBUG:teuthology.orchestra.run.smithi110:osd.5> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T04:57:31.446 INFO:tasks.cephadm:Deploying osd.6 on smithi110 with /dev/vg_nvme/lv_2... 2024-09-21T04:57:31.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: cluster 2024-09-21T04:57:30.589321+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.751255+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: cluster 2024-09-21T04:57:30.759527+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.760357+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.765970+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.840909+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.848884+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[19831]: audit 2024-09-21T04:57:30.859086+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: cluster 2024-09-21T04:57:30.589321+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.751255+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:57:32.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: cluster 2024-09-21T04:57:30.759527+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-21T04:57:32.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.760357+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.765970+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.840909+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:32.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.848884+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:32.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:31 smithi089 bash[26514]: audit 2024-09-21T04:57:30.859086+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: cluster 2024-09-21T04:57:30.589321+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.751255+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: cluster 2024-09-21T04:57:30.759527+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e38: 6 total, 5 up, 6 in 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.760357+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.765970+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:32.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.840909+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:57:32.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.848884+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:32.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:31 smithi110 bash[22020]: audit 2024-09-21T04:57:30.859086+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: cluster 2024-09-21T04:57:30.504524+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: cluster 2024-09-21T04:57:30.504644+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: cluster 2024-09-21T04:57:31.761018+0000 mon.a (mon.0) 536 : cluster [INF] osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566] boot 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: cluster 2024-09-21T04:57:31.761121+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: audit 2024-09-21T04:57:31.762301+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[19831]: cluster 2024-09-21T04:57:31.795451+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-21T04:57:33.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: cluster 2024-09-21T04:57:30.504524+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:57:33.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: cluster 2024-09-21T04:57:30.504644+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:57:33.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: cluster 2024-09-21T04:57:31.761018+0000 mon.a (mon.0) 536 : cluster [INF] osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566] boot 2024-09-21T04:57:33.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: cluster 2024-09-21T04:57:31.761121+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-21T04:57:33.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: audit 2024-09-21T04:57:31.762301+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:33.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:32 smithi089 bash[26514]: cluster 2024-09-21T04:57:31.795451+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-21T04:57:33.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: cluster 2024-09-21T04:57:30.504524+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:57:33.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: cluster 2024-09-21T04:57:30.504644+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:57:33.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: cluster 2024-09-21T04:57:31.761018+0000 mon.a (mon.0) 536 : cluster [INF] osd.5 [v2:172.21.15.110:6808/1758841566,v1:172.21.15.110:6809/1758841566] boot 2024-09-21T04:57:33.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: cluster 2024-09-21T04:57:31.761121+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-21T04:57:33.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: audit 2024-09-21T04:57:31.762301+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T04:57:33.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:32 smithi110 bash[22020]: cluster 2024-09-21T04:57:31.795451+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-21T04:57:34.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:33 smithi089 bash[19831]: cluster 2024-09-21T04:57:32.589954+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:34.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:33 smithi089 bash[19831]: cluster 2024-09-21T04:57:32.804463+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-21T04:57:34.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:33 smithi089 bash[26514]: cluster 2024-09-21T04:57:32.589954+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:34.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:33 smithi089 bash[26514]: cluster 2024-09-21T04:57:32.804463+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-21T04:57:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:33 smithi110 bash[22020]: cluster 2024-09-21T04:57:32.589954+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:33 smithi110 bash[22020]: cluster 2024-09-21T04:57:32.804463+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-21T04:57:35.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:34 smithi089 bash[19831]: cluster 2024-09-21T04:57:33.806521+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-21T04:57:35.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:34 smithi089 bash[19831]: cluster 2024-09-21T04:57:34.808412+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-21T04:57:35.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:34 smithi089 bash[26514]: cluster 2024-09-21T04:57:33.806521+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-21T04:57:35.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:34 smithi089 bash[26514]: cluster 2024-09-21T04:57:34.808412+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-21T04:57:35.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:34 smithi110 bash[22020]: cluster 2024-09-21T04:57:33.806521+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-21T04:57:35.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:34 smithi110 bash[22020]: cluster 2024-09-21T04:57:34.808412+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-09-21T04:57:35.913 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:57:36.128 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:35 smithi110 bash[22020]: cluster 2024-09-21T04:57:34.590462+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:36.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:35 smithi089 bash[19831]: cluster 2024-09-21T04:57:34.590462+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:36.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:35 smithi089 bash[26514]: cluster 2024-09-21T04:57:34.590462+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:37.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:36 smithi089 bash[19831]: cluster 2024-09-21T04:57:36.590981+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:37.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:36 smithi089 bash[26514]: cluster 2024-09-21T04:57:36.590981+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:37.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:36 smithi110 bash[22020]: cluster 2024-09-21T04:57:36.590981+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:40.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:39 smithi089 bash[19831]: cluster 2024-09-21T04:57:38.591555+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:40.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:39 smithi089 bash[26514]: cluster 2024-09-21T04:57:38.591555+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:40.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:39 smithi110 bash[22020]: cluster 2024-09-21T04:57:38.591555+0000 mgr.y (mgr.14150) 261 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:40.813 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:57:40.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-09-21T04:57:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:41 smithi089 bash[19831]: cluster 2024-09-21T04:57:40.592103+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:41 smithi089 bash[26514]: cluster 2024-09-21T04:57:40.592103+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:42.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:41 smithi110 bash[22020]: cluster 2024-09-21T04:57:40.592103+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:44.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: cluster 2024-09-21T04:57:42.592666+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:44.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.618694+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.627372+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.630093+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.631958+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.640383+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.644747+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[19831]: audit 2024-09-21T04:57:43.646561+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: cluster 2024-09-21T04:57:42.592666+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.618694+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.627372+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.630093+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.631958+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.640383+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.644747+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:43 smithi089 bash[26514]: audit 2024-09-21T04:57:43.646561+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: cluster 2024-09-21T04:57:42.592666+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.618694+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.627372+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.630093+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.631958+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.640383+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.644747+0000 mon.a (mon.0) 548 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:43 smithi110 bash[22020]: audit 2024-09-21T04:57:43.646561+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:57:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[19831]: cephadm 2024-09-21T04:57:43.610281+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:57:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[19831]: cephadm 2024-09-21T04:57:43.633381+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 8632M 2024-09-21T04:57:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[19831]: audit 2024-09-21T04:57:43.656253+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[26514]: cephadm 2024-09-21T04:57:43.610281+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:57:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[26514]: cephadm 2024-09-21T04:57:43.633381+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 8632M 2024-09-21T04:57:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:44 smithi089 bash[26514]: audit 2024-09-21T04:57:43.656253+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:44 smithi110 bash[22020]: cephadm 2024-09-21T04:57:43.610281+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:57:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:44 smithi110 bash[22020]: cephadm 2024-09-21T04:57:43.633381+0000 mgr.y (mgr.14150) 265 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 8632M 2024-09-21T04:57:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:44 smithi110 bash[22020]: audit 2024-09-21T04:57:43.656253+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:57:46.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:45 smithi089 bash[19831]: cluster 2024-09-21T04:57:44.593181+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:46.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:45 smithi089 bash[26514]: cluster 2024-09-21T04:57:44.593181+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:45 smithi110 bash[22020]: cluster 2024-09-21T04:57:44.593181+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:46.086 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:57:48.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[26514]: cluster 2024-09-21T04:57:46.593725+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:48.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[26514]: audit 2024-09-21T04:57:47.498969+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:57:48.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[26514]: audit 2024-09-21T04:57:47.505119+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:57:48.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[26514]: audit 2024-09-21T04:57:47.506828+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:48.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[19831]: cluster 2024-09-21T04:57:46.593725+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:48.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[19831]: audit 2024-09-21T04:57:47.498969+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:57:48.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[19831]: audit 2024-09-21T04:57:47.505119+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:57:48.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:47 smithi089 bash[19831]: audit 2024-09-21T04:57:47.506828+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:47 smithi110 bash[22020]: cluster 2024-09-21T04:57:46.593725+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:47 smithi110 bash[22020]: audit 2024-09-21T04:57:47.498969+0000 mon.a (mon.0) 551 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:47 smithi110 bash[22020]: audit 2024-09-21T04:57:47.505119+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:57:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:47 smithi110 bash[22020]: audit 2024-09-21T04:57:47.506828+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:57:49.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:48 smithi089 bash[26514]: audit 2024-09-21T04:57:47.492655+0000 mgr.y (mgr.14150) 268 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:48 smithi089 bash[19831]: audit 2024-09-21T04:57:47.492655+0000 mgr.y (mgr.14150) 268 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:49.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:48 smithi110 bash[22020]: audit 2024-09-21T04:57:47.492655+0000 mgr.y (mgr.14150) 268 : audit [DBG] from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:57:50.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:49 smithi089 bash[26514]: cluster 2024-09-21T04:57:48.594355+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:50.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:49 smithi089 bash[19831]: cluster 2024-09-21T04:57:48.594355+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:50.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:49 smithi110 bash[22020]: cluster 2024-09-21T04:57:48.594355+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:52.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:51 smithi089 bash[19831]: cluster 2024-09-21T04:57:50.594914+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:52.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:51 smithi089 bash[26514]: cluster 2024-09-21T04:57:50.594914+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:52.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:51 smithi110 bash[22020]: cluster 2024-09-21T04:57:50.594914+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:54.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:53 smithi089 bash[19831]: cluster 2024-09-21T04:57:52.595566+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:54.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:53 smithi089 bash[26514]: cluster 2024-09-21T04:57:52.595566+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:54.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:53 smithi110 bash[22020]: cluster 2024-09-21T04:57:52.595566+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:56.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:55 smithi089 bash[26514]: cluster 2024-09-21T04:57:54.596232+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:56.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:55 smithi089 bash[19831]: cluster 2024-09-21T04:57:54.596232+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:55 smithi110 bash[22020]: cluster 2024-09-21T04:57:54.596232+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: audit 2024-09-21T04:57:55.936935+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: audit 2024-09-21T04:57:55.937005+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.110:0/2622445378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: audit 2024-09-21T04:57:55.941785+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]': finished 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: cluster 2024-09-21T04:57:55.948729+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: audit 2024-09-21T04:57:55.949116+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: audit 2024-09-21T04:57:56.570332+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.110:0/2263093307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[19831]: cluster 2024-09-21T04:57:56.596775+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:57.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: audit 2024-09-21T04:57:55.936935+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: audit 2024-09-21T04:57:55.937005+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.110:0/2622445378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: audit 2024-09-21T04:57:55.941785+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]': finished 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: cluster 2024-09-21T04:57:55.948729+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: audit 2024-09-21T04:57:55.949116+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: audit 2024-09-21T04:57:56.570332+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.110:0/2263093307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:57.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:56 smithi089 bash[26514]: cluster 2024-09-21T04:57:56.596775+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: audit 2024-09-21T04:57:55.936935+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: audit 2024-09-21T04:57:55.937005+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.110:0/2622445378' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]: dispatch 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: audit 2024-09-21T04:57:55.941785+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd2cbf05-398e-4f6c-a58f-ac9f7402f06f"}]': finished 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: cluster 2024-09-21T04:57:55.948729+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: audit 2024-09-21T04:57:55.949116+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: audit 2024-09-21T04:57:56.570332+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.110:0/2263093307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:57:57.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:56 smithi110 bash[22020]: cluster 2024-09-21T04:57:56.596775+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:00.007 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:57:59 smithi110 bash[22020]: cluster 2024-09-21T04:57:58.597314+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:00.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:57:59 smithi089 bash[19831]: cluster 2024-09-21T04:57:58.597314+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:00.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:57:59 smithi089 bash[26514]: cluster 2024-09-21T04:57:58.597314+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:01 smithi089 bash[19831]: cluster 2024-09-21T04:58:00.597856+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:02.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:01 smithi089 bash[26514]: cluster 2024-09-21T04:58:00.597856+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:02.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:01 smithi110 bash[22020]: cluster 2024-09-21T04:58:00.597856+0000 mgr.y (mgr.14150) 275 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:04.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:03 smithi089 bash[19831]: cluster 2024-09-21T04:58:02.598360+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:04.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:03 smithi089 bash[26514]: cluster 2024-09-21T04:58:02.598360+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:03 smithi110 bash[22020]: cluster 2024-09-21T04:58:02.598360+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:06.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:05 smithi089 bash[26514]: cluster 2024-09-21T04:58:04.598914+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:06.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:05 smithi089 bash[19831]: cluster 2024-09-21T04:58:04.598914+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:05 smithi110 bash[22020]: cluster 2024-09-21T04:58:04.598914+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:07 smithi089 bash[26514]: cluster 2024-09-21T04:58:06.599521+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:08.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:07 smithi089 bash[19831]: cluster 2024-09-21T04:58:06.599521+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:08.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:07 smithi110 bash[22020]: cluster 2024-09-21T04:58:06.599521+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[19831]: cluster 2024-09-21T04:58:08.600185+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[19831]: audit 2024-09-21T04:58:09.231747+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[19831]: audit 2024-09-21T04:58:09.233328+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[26514]: cluster 2024-09-21T04:58:08.600185+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[26514]: audit 2024-09-21T04:58:09.231747+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-21T04:58:10.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:09 smithi089 bash[26514]: audit 2024-09-21T04:58:09.233328+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:10.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:09 smithi110 bash[22020]: cluster 2024-09-21T04:58:08.600185+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:10.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:09 smithi110 bash[22020]: audit 2024-09-21T04:58:09.231747+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-21T04:58:10.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:09 smithi110 bash[22020]: audit 2024-09-21T04:58:09.233328+0000 mon.a (mon.0) 559 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:11.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:10 smithi110 bash[22020]: cephadm 2024-09-21T04:58:09.234687+0000 mgr.y (mgr.14150) 280 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T04:58:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:10 smithi089 bash[19831]: cephadm 2024-09-21T04:58:09.234687+0000 mgr.y (mgr.14150) 280 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T04:58:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:10 smithi089 bash[26514]: cephadm 2024-09-21T04:58:09.234687+0000 mgr.y (mgr.14150) 280 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T04:58:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:11 smithi089 bash[19831]: cluster 2024-09-21T04:58:10.600751+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:12.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:11 smithi089 bash[26514]: cluster 2024-09-21T04:58:10.600751+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:11 smithi110 bash[22020]: cluster 2024-09-21T04:58:10.600751+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:13.689 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.689 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.689 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.690 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.988 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.988 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.988 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:13.988 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:13 smithi110 bash[22020]: cluster 2024-09-21T04:58:12.601316+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:13.989 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:13 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:58:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:13 smithi089 bash[19831]: cluster 2024-09-21T04:58:12.601316+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:14.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:13 smithi089 bash[26514]: cluster 2024-09-21T04:58:12.601316+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[19831]: audit 2024-09-21T04:58:13.912565+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[19831]: audit 2024-09-21T04:58:13.920231+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[19831]: audit 2024-09-21T04:58:13.930469+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[26514]: audit 2024-09-21T04:58:13.912565+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[26514]: audit 2024-09-21T04:58:13.920231+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:14 smithi089 bash[26514]: audit 2024-09-21T04:58:13.930469+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:14 smithi110 bash[22020]: audit 2024-09-21T04:58:13.912565+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:14 smithi110 bash[22020]: audit 2024-09-21T04:58:13.920231+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:14 smithi110 bash[22020]: audit 2024-09-21T04:58:13.930469+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:15 smithi089 bash[19831]: cluster 2024-09-21T04:58:14.601851+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:16.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:15 smithi089 bash[26514]: cluster 2024-09-21T04:58:14.601851+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:16.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:15 smithi110 bash[22020]: cluster 2024-09-21T04:58:14.601851+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:17.965 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:17 smithi110 bash[22020]: cluster 2024-09-21T04:58:16.602386+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:17 smithi089 bash[19831]: cluster 2024-09-21T04:58:16.602386+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:17 smithi089 bash[26514]: cluster 2024-09-21T04:58:16.602386+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:19 smithi110 bash[22020]: cluster 2024-09-21T04:58:18.603026+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:19 smithi089 bash[19831]: cluster 2024-09-21T04:58:18.603026+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:19 smithi089 bash[26514]: cluster 2024-09-21T04:58:18.603026+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: cluster 2024-09-21T04:58:20.603694+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: audit 2024-09-21T04:58:20.712859+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: audit 2024-09-21T04:58:20.721637+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: audit 2024-09-21T04:58:21.397301+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: audit 2024-09-21T04:58:21.399180+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[26514]: audit 2024-09-21T04:58:21.408329+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: cluster 2024-09-21T04:58:20.603694+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: audit 2024-09-21T04:58:20.712859+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: audit 2024-09-21T04:58:20.721637+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: audit 2024-09-21T04:58:21.397301+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: audit 2024-09-21T04:58:21.399180+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:22.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:21 smithi089 bash[19831]: audit 2024-09-21T04:58:21.408329+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: cluster 2024-09-21T04:58:20.603694+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: audit 2024-09-21T04:58:20.712859+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: audit 2024-09-21T04:58:20.721637+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: audit 2024-09-21T04:58:21.397301+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: audit 2024-09-21T04:58:21.399180+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:21 smithi110 bash[22020]: audit 2024-09-21T04:58:21.408329+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:24.003 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:23 smithi110 bash[22020]: cluster 2024-09-21T04:58:22.604296+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:24.003 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:23 smithi110 bash[22020]: audit 2024-09-21T04:58:23.101274+0000 mon.a (mon.0) 568 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.003 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:23 smithi110 bash[22020]: audit 2024-09-21T04:58:23.101514+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[26514]: cluster 2024-09-21T04:58:22.604296+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[26514]: audit 2024-09-21T04:58:23.101274+0000 mon.a (mon.0) 568 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[26514]: audit 2024-09-21T04:58:23.101514+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[19831]: cluster 2024-09-21T04:58:22.604296+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:24.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[19831]: audit 2024-09-21T04:58:23.101274+0000 mon.a (mon.0) 568 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:23 smithi089 bash[19831]: audit 2024-09-21T04:58:23.101514+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-21T04:58:24.478 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 6 on host 'smithi110' 2024-09-21T04:58:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:23.718456+0000 mon.a (mon.0) 569 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T04:58:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:23.723145+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: cluster 2024-09-21T04:58:23.727994+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-21T04:58:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:23.729095+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:23.729793+0000 mon.a (mon.0) 572 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:24.454526+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:24.461835+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:24.472094+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:24.720889+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: cluster 2024-09-21T04:58:24.728242+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-21T04:58:24.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:24 smithi110 bash[22020]: audit 2024-09-21T04:58:24.728855+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:23.718456+0000 mon.a (mon.0) 569 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:23.723145+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: cluster 2024-09-21T04:58:23.727994+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:23.729095+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:23.729793+0000 mon.a (mon.0) 572 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:24.454526+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:24.461835+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:24.472094+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:24.720889+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: cluster 2024-09-21T04:58:24.728242+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-21T04:58:25.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[19831]: audit 2024-09-21T04:58:24.728855+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:23.718456+0000 mon.a (mon.0) 569 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:23.723145+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: cluster 2024-09-21T04:58:23.727994+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:23.729095+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:23.729793+0000 mon.a (mon.0) 572 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:24.454526+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:24.461835+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:24.472094+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:24.720889+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: cluster 2024-09-21T04:58:24.728242+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e46: 7 total, 6 up, 7 in 2024-09-21T04:58:25.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:24 smithi089 bash[26514]: audit 2024-09-21T04:58:24.728855+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:25.129 DEBUG:teuthology.orchestra.run.smithi110:osd.6> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T04:58:25.131 INFO:tasks.cephadm:Deploying osd.7 on smithi110 with /dev/vg_nvme/lv_1... 2024-09-21T04:58:25.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T04:58:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[19831]: cluster 2024-09-21T04:58:24.604831+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[19831]: audit 2024-09-21T04:58:24.740779+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[19831]: audit 2024-09-21T04:58:25.003938+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' 2024-09-21T04:58:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[26514]: cluster 2024-09-21T04:58:24.604831+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[26514]: audit 2024-09-21T04:58:24.740779+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:25 smithi089 bash[26514]: audit 2024-09-21T04:58:25.003938+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' 2024-09-21T04:58:26.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:25 smithi110 bash[22020]: cluster 2024-09-21T04:58:24.604831+0000 mgr.y (mgr.14150) 288 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:26.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:25 smithi110 bash[22020]: audit 2024-09-21T04:58:24.740779+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:26.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:25 smithi110 bash[22020]: audit 2024-09-21T04:58:25.003938+0000 mon.a (mon.0) 580 : audit [INF] from='osd.6 ' entity='osd.6' 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: cluster 2024-09-21T04:58:24.097426+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: cluster 2024-09-21T04:58:24.097514+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: cluster 2024-09-21T04:58:25.731472+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513] boot 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: cluster 2024-09-21T04:58:25.731630+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: audit 2024-09-21T04:58:25.731941+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[19831]: cluster 2024-09-21T04:58:26.733211+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: cluster 2024-09-21T04:58:24.097426+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: cluster 2024-09-21T04:58:24.097514+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: cluster 2024-09-21T04:58:25.731472+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513] boot 2024-09-21T04:58:27.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: cluster 2024-09-21T04:58:25.731630+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-21T04:58:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: audit 2024-09-21T04:58:25.731941+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:27.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:26 smithi089 bash[26514]: cluster 2024-09-21T04:58:26.733211+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: cluster 2024-09-21T04:58:24.097426+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: cluster 2024-09-21T04:58:24.097514+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: cluster 2024-09-21T04:58:25.731472+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.110:6816/3802633513,v1:172.21.15.110:6817/3802633513] boot 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: cluster 2024-09-21T04:58:25.731630+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: audit 2024-09-21T04:58:25.731941+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T04:58:27.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:26 smithi110 bash[22020]: cluster 2024-09-21T04:58:26.733211+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-21T04:58:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:27 smithi089 bash[19831]: cluster 2024-09-21T04:58:26.605369+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:28.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:27 smithi089 bash[19831]: cluster 2024-09-21T04:58:27.736254+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-21T04:58:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:27 smithi089 bash[26514]: cluster 2024-09-21T04:58:26.605369+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:27 smithi089 bash[26514]: cluster 2024-09-21T04:58:27.736254+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-21T04:58:28.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:27 smithi110 bash[22020]: cluster 2024-09-21T04:58:26.605369+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-21T04:58:28.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:27 smithi110 bash[22020]: cluster 2024-09-21T04:58:27.736254+0000 mon.a (mon.0) 585 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-21T04:58:29.562 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:58:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:29 smithi089 bash[19831]: cluster 2024-09-21T04:58:28.605945+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:29 smithi089 bash[19831]: cluster 2024-09-21T04:58:28.770830+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-21T04:58:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:29 smithi089 bash[26514]: cluster 2024-09-21T04:58:28.605945+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:29 smithi089 bash[26514]: cluster 2024-09-21T04:58:28.770830+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-21T04:58:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:29 smithi110 bash[22020]: cluster 2024-09-21T04:58:28.605945+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:29 smithi110 bash[22020]: cluster 2024-09-21T04:58:28.770830+0000 mon.a (mon.0) 586 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-21T04:58:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:30 smithi089 bash[19831]: cluster 2024-09-21T04:58:29.771041+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-21T04:58:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:30 smithi089 bash[26514]: cluster 2024-09-21T04:58:29.771041+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-21T04:58:31.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:30 smithi110 bash[22020]: cluster 2024-09-21T04:58:29.771041+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e51: 7 total, 7 up, 7 in 2024-09-21T04:58:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:31 smithi089 bash[19831]: cluster 2024-09-21T04:58:30.606513+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:58:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:31 smithi089 bash[26514]: cluster 2024-09-21T04:58:30.606513+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:58:32.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:31 smithi110 bash[22020]: cluster 2024-09-21T04:58:30.606513+0000 mgr.y (mgr.14150) 291 : cluster [DBG] pgmap v274: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T04:58:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:33 smithi089 bash[26514]: cluster 2024-09-21T04:58:32.607109+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T04:58:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:33 smithi089 bash[19831]: cluster 2024-09-21T04:58:32.607109+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T04:58:34.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:33 smithi110 bash[22020]: cluster 2024-09-21T04:58:32.607109+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: cluster 2024-09-21T04:58:34.607657+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.082122+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.092708+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.095909+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.097806+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.099771+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.109759+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.114124+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:36.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.115838+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[19831]: audit 2024-09-21T04:58:35.127804+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: cluster 2024-09-21T04:58:34.607657+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.082122+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.092708+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.095909+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.097806+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.099771+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.109759+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.114124+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:36.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.115838+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:36.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:35 smithi089 bash[26514]: audit 2024-09-21T04:58:35.127804+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: cluster 2024-09-21T04:58:34.607657+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.082122+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.092708+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.095909+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.097806+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.099771+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.109759+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:36.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.114124+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.115838+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:58:36.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:35 smithi110 bash[22020]: audit 2024-09-21T04:58:35.127804+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:58:37.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:36 smithi110 bash[22020]: cephadm 2024-09-21T04:58:35.071664+0000 mgr.y (mgr.14150) 294 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:58:37.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:36 smithi110 bash[22020]: cephadm 2024-09-21T04:58:35.101255+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 5755M 2024-09-21T04:58:37.223 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-21T04:58:37.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi110:vg_nvme/lv_1 2024-09-21T04:58:37.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:36 smithi089 bash[26514]: cephadm 2024-09-21T04:58:35.071664+0000 mgr.y (mgr.14150) 294 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:58:37.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:36 smithi089 bash[26514]: cephadm 2024-09-21T04:58:35.101255+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 5755M 2024-09-21T04:58:37.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:36 smithi089 bash[19831]: cephadm 2024-09-21T04:58:35.071664+0000 mgr.y (mgr.14150) 294 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:58:37.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:36 smithi089 bash[19831]: cephadm 2024-09-21T04:58:35.101255+0000 mgr.y (mgr.14150) 295 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 5755M 2024-09-21T04:58:38.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:37 smithi089 bash[19831]: cluster 2024-09-21T04:58:36.608252+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T04:58:38.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:37 smithi089 bash[26514]: cluster 2024-09-21T04:58:36.608252+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T04:58:38.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:37 smithi110 bash[22020]: cluster 2024-09-21T04:58:36.608252+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T04:58:40.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:39 smithi089 bash[19831]: cluster 2024-09-21T04:58:38.608809+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:40.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:39 smithi089 bash[26514]: cluster 2024-09-21T04:58:38.608809+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:40.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:39 smithi110 bash[22020]: cluster 2024-09-21T04:58:38.608809+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:42.027 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:58:42.123 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:41 smithi110 bash[22020]: cluster 2024-09-21T04:58:40.609373+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:41 smithi089 bash[19831]: cluster 2024-09-21T04:58:40.609373+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:42.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:41 smithi089 bash[26514]: cluster 2024-09-21T04:58:40.609373+0000 mgr.y (mgr.14150) 298 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[19831]: cluster 2024-09-21T04:58:42.609974+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[19831]: audit 2024-09-21T04:58:43.360210+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:58:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[19831]: audit 2024-09-21T04:58:43.366124+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:58:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[19831]: audit 2024-09-21T04:58:43.367607+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[26514]: cluster 2024-09-21T04:58:42.609974+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[26514]: audit 2024-09-21T04:58:43.360210+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:58:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[26514]: audit 2024-09-21T04:58:43.366124+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:58:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:43 smithi089 bash[26514]: audit 2024-09-21T04:58:43.367607+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:44.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:43 smithi110 bash[22020]: cluster 2024-09-21T04:58:42.609974+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:44.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:43 smithi110 bash[22020]: audit 2024-09-21T04:58:43.360210+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T04:58:44.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:43 smithi110 bash[22020]: audit 2024-09-21T04:58:43.366124+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T04:58:44.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:43 smithi110 bash[22020]: audit 2024-09-21T04:58:43.367607+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:58:45.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:44 smithi089 bash[19831]: audit 2024-09-21T04:58:43.353936+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:45.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:44 smithi089 bash[26514]: audit 2024-09-21T04:58:43.353936+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:45.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:44 smithi110 bash[22020]: audit 2024-09-21T04:58:43.353936+0000 mgr.y (mgr.14150) 300 : audit [DBG] from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:58:46.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:45 smithi089 bash[19831]: cluster 2024-09-21T04:58:44.610453+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:46.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:45 smithi089 bash[26514]: cluster 2024-09-21T04:58:44.610453+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:46.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:45 smithi110 bash[22020]: cluster 2024-09-21T04:58:44.610453+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:47.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:46 smithi089 bash[19831]: cluster 2024-09-21T04:58:46.611004+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:47.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:46 smithi089 bash[26514]: cluster 2024-09-21T04:58:46.611004+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:47.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:46 smithi110 bash[22020]: cluster 2024-09-21T04:58:46.611004+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:49 smithi089 bash[19831]: cluster 2024-09-21T04:58:48.611587+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:49 smithi089 bash[26514]: cluster 2024-09-21T04:58:48.611587+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:49 smithi110 bash[22020]: cluster 2024-09-21T04:58:48.611587+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:51 smithi089 bash[19831]: cluster 2024-09-21T04:58:50.612129+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:52.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:51 smithi089 bash[26514]: cluster 2024-09-21T04:58:50.612129+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:52.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:51 smithi110 bash[22020]: cluster 2024-09-21T04:58:50.612129+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: audit 2024-09-21T04:58:51.917460+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.110:0/1940217190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: audit 2024-09-21T04:58:51.917747+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: audit 2024-09-21T04:58:51.922637+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]': finished 2024-09-21T04:58:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: cluster 2024-09-21T04:58:51.928110+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: audit 2024-09-21T04:58:51.928737+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[19831]: audit 2024-09-21T04:58:52.554160+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.110:0/2301103462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: audit 2024-09-21T04:58:51.917460+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.110:0/1940217190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: audit 2024-09-21T04:58:51.917747+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: audit 2024-09-21T04:58:51.922637+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]': finished 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: cluster 2024-09-21T04:58:51.928110+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: audit 2024-09-21T04:58:51.928737+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:58:53.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:52 smithi089 bash[26514]: audit 2024-09-21T04:58:52.554160+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.110:0/2301103462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: audit 2024-09-21T04:58:51.917460+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.110:0/1940217190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: audit 2024-09-21T04:58:51.917747+0000 mon.a (mon.0) 600 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]: dispatch 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: audit 2024-09-21T04:58:51.922637+0000 mon.a (mon.0) 601 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee200566-ff5d-4490-9bd2-0f76dae3856c"}]': finished 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: cluster 2024-09-21T04:58:51.928110+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: audit 2024-09-21T04:58:51.928737+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:58:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:52 smithi110 bash[22020]: audit 2024-09-21T04:58:52.554160+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.110:0/2301103462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T04:58:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:53 smithi089 bash[19831]: cluster 2024-09-21T04:58:52.612692+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:53 smithi089 bash[26514]: cluster 2024-09-21T04:58:52.612692+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:53 smithi110 bash[22020]: cluster 2024-09-21T04:58:52.612692+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:55.964 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:55 smithi110 bash[22020]: cluster 2024-09-21T04:58:54.613228+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:55 smithi089 bash[19831]: cluster 2024-09-21T04:58:54.613228+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:55 smithi089 bash[26514]: cluster 2024-09-21T04:58:54.613228+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:57 smithi089 bash[19831]: cluster 2024-09-21T04:58:56.613795+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:57 smithi089 bash[26514]: cluster 2024-09-21T04:58:56.613795+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:58:58.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:57 smithi110 bash[22020]: cluster 2024-09-21T04:58:56.613795+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:58:59 smithi089 bash[19831]: cluster 2024-09-21T04:58:58.614371+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:58:59 smithi089 bash[26514]: cluster 2024-09-21T04:58:58.614371+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:58:59 smithi110 bash[22020]: cluster 2024-09-21T04:58:58.614371+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:01 smithi089 bash[19831]: cluster 2024-09-21T04:59:00.614918+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:01 smithi089 bash[26514]: cluster 2024-09-21T04:59:00.614918+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:02.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:01 smithi110 bash[22020]: cluster 2024-09-21T04:59:00.614918+0000 mgr.y (mgr.14150) 309 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:03 smithi110 bash[22020]: cluster 2024-09-21T04:59:02.615515+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:04.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:03 smithi089 bash[19831]: cluster 2024-09-21T04:59:02.615515+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:03 smithi089 bash[26514]: cluster 2024-09-21T04:59:02.615515+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:06.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:05 smithi110 bash[22020]: cluster 2024-09-21T04:59:04.616066+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:06.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:05 smithi110 bash[22020]: audit 2024-09-21T04:59:05.439549+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-21T04:59:06.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:05 smithi110 bash[22020]: audit 2024-09-21T04:59:05.441355+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[19831]: cluster 2024-09-21T04:59:04.616066+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[19831]: audit 2024-09-21T04:59:05.439549+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[19831]: audit 2024-09-21T04:59:05.441355+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[26514]: cluster 2024-09-21T04:59:04.616066+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[26514]: audit 2024-09-21T04:59:05.439549+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-21T04:59:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:05 smithi089 bash[26514]: audit 2024-09-21T04:59:05.441355+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:06.962 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:06 smithi110 bash[22020]: cephadm 2024-09-21T04:59:05.442942+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T04:59:07.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:06 smithi089 bash[19831]: cephadm 2024-09-21T04:59:05.442942+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T04:59:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:06 smithi089 bash[26514]: cephadm 2024-09-21T04:59:05.442942+0000 mgr.y (mgr.14150) 312 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T04:59:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:07 smithi089 bash[19831]: cluster 2024-09-21T04:59:06.616615+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:07 smithi089 bash[26514]: cluster 2024-09-21T04:59:06.616615+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:07 smithi110 bash[22020]: cluster 2024-09-21T04:59:06.616615+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:09.910 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:59:09 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:09.911 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:59:09 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:09.911 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 04:59:09 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:09.911 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:09 smithi110 bash[22020]: cluster 2024-09-21T04:59:08.617204+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:09.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:09 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:09.912 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 04:59:09 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:09 smithi089 bash[19831]: cluster 2024-09-21T04:59:08.617204+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:09 smithi089 bash[26514]: cluster 2024-09-21T04:59:08.617204+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:10.196 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:10.197 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 04:59:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:10.197 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 04:59:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:10.197 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 04:59:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:10.198 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 04:59:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[19831]: audit 2024-09-21T04:59:10.202248+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[19831]: audit 2024-09-21T04:59:10.209865+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[19831]: audit 2024-09-21T04:59:10.218343+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[26514]: audit 2024-09-21T04:59:10.202248+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[26514]: audit 2024-09-21T04:59:10.209865+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:10 smithi089 bash[26514]: audit 2024-09-21T04:59:10.218343+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:10 smithi110 bash[22020]: audit 2024-09-21T04:59:10.202248+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:10 smithi110 bash[22020]: audit 2024-09-21T04:59:10.209865+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:10 smithi110 bash[22020]: audit 2024-09-21T04:59:10.218343+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:11 smithi089 bash[19831]: cluster 2024-09-21T04:59:10.617801+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:11 smithi089 bash[26514]: cluster 2024-09-21T04:59:10.617801+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:11 smithi110 bash[22020]: cluster 2024-09-21T04:59:10.617801+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:13 smithi089 bash[19831]: cluster 2024-09-21T04:59:12.618412+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:13 smithi089 bash[26514]: cluster 2024-09-21T04:59:12.618412+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:13 smithi110 bash[22020]: cluster 2024-09-21T04:59:12.618412+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:15.993 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:15 smithi110 bash[22020]: cluster 2024-09-21T04:59:14.618962+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:15 smithi089 bash[19831]: cluster 2024-09-21T04:59:14.618962+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:15 smithi089 bash[26514]: cluster 2024-09-21T04:59:14.618962+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: cluster 2024-09-21T04:59:16.619508+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: audit 2024-09-21T04:59:16.738509+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: audit 2024-09-21T04:59:16.747240+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: audit 2024-09-21T04:59:16.749184+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: audit 2024-09-21T04:59:16.750962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[19831]: audit 2024-09-21T04:59:16.760433+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: cluster 2024-09-21T04:59:16.619508+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: audit 2024-09-21T04:59:16.738509+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: audit 2024-09-21T04:59:16.747240+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: audit 2024-09-21T04:59:16.749184+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: audit 2024-09-21T04:59:16.750962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:17 smithi089 bash[26514]: audit 2024-09-21T04:59:16.760433+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: cluster 2024-09-21T04:59:16.619508+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: audit 2024-09-21T04:59:16.738509+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: audit 2024-09-21T04:59:16.747240+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: audit 2024-09-21T04:59:16.749184+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: audit 2024-09-21T04:59:16.750962+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:17 smithi110 bash[22020]: audit 2024-09-21T04:59:16.760433+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[26514]: cluster 2024-09-21T04:59:18.620083+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[26514]: audit 2024-09-21T04:59:19.464121+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[26514]: audit 2024-09-21T04:59:19.464494+0000 mon.a (mon.0) 614 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[19831]: cluster 2024-09-21T04:59:18.620083+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[19831]: audit 2024-09-21T04:59:19.464121+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:19 smithi089 bash[19831]: audit 2024-09-21T04:59:19.464494+0000 mon.a (mon.0) 614 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:19 smithi110 bash[22020]: cluster 2024-09-21T04:59:18.620083+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:20.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:19 smithi110 bash[22020]: audit 2024-09-21T04:59:19.464121+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:19 smithi110 bash[22020]: audit 2024-09-21T04:59:19.464494+0000 mon.a (mon.0) 614 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-21T04:59:20.399 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 7 on host 'smithi110' 2024-09-21T04:59:20.987 DEBUG:teuthology.orchestra.run.smithi110:osd.7> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T04:59:20.989 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-21T04:59:20.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T04:59:21.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:19.741231+0000 mon.a (mon.0) 615 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T04:59:21.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:19.745292+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: cluster 2024-09-21T04:59:19.746478+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:19.747464+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:19.748079+0000 mon.a (mon.0) 618 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:20.378518+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:20.386058+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:20.395045+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.020 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:20 smithi110 bash[22020]: audit 2024-09-21T04:59:20.743612+0000 mon.a (mon.0) 622 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:59:21.084 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:19.741231+0000 mon.a (mon.0) 615 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T04:59:21.084 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:19.745292+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.084 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: cluster 2024-09-21T04:59:19.746478+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:19.747464+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:19.748079+0000 mon.a (mon.0) 618 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:20.378518+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:20.386058+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:20.395045+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[26514]: audit 2024-09-21T04:59:20.743612+0000 mon.a (mon.0) 622 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:19.741231+0000 mon.a (mon.0) 615 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:19.745292+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: cluster 2024-09-21T04:59:19.746478+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:19.747464+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:19.748079+0000 mon.a (mon.0) 618 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:20.378518+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:21.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:20.386058+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:20.395045+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:21.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:20 smithi089 bash[19831]: audit 2024-09-21T04:59:20.743612+0000 mon.a (mon.0) 622 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-21T04:59:21.116 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[42001]: debug 2024-09-21T04:59:21.061+0000 7ff84ef0c640 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[19831]: cluster 2024-09-21T04:59:20.620606+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[19831]: cluster 2024-09-21T04:59:20.749395+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[19831]: audit 2024-09-21T04:59:20.750580+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[19831]: audit 2024-09-21T04:59:20.759906+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[19831]: audit 2024-09-21T04:59:21.029118+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-21T04:59:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[26514]: cluster 2024-09-21T04:59:20.620606+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[26514]: cluster 2024-09-21T04:59:20.749395+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-21T04:59:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[26514]: audit 2024-09-21T04:59:20.750580+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[26514]: audit 2024-09-21T04:59:20.759906+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:21 smithi089 bash[26514]: audit 2024-09-21T04:59:21.029118+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-21T04:59:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[22020]: cluster 2024-09-21T04:59:20.620606+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[22020]: cluster 2024-09-21T04:59:20.749395+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e54: 8 total, 7 up, 8 in 2024-09-21T04:59:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[22020]: audit 2024-09-21T04:59:20.750580+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[22020]: audit 2024-09-21T04:59:20.759906+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:21 smithi110 bash[22020]: audit 2024-09-21T04:59:21.029118+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: cluster 2024-09-21T04:59:20.488352+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: cluster 2024-09-21T04:59:20.488426+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: cluster 2024-09-21T04:59:21.758070+0000 mon.a (mon.0) 627 : cluster [INF] osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867] boot 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: cluster 2024-09-21T04:59:21.758242+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: audit 2024-09-21T04:59:21.758671+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[19831]: cluster 2024-09-21T04:59:21.820015+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: cluster 2024-09-21T04:59:20.488352+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: cluster 2024-09-21T04:59:20.488426+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: cluster 2024-09-21T04:59:21.758070+0000 mon.a (mon.0) 627 : cluster [INF] osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867] boot 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: cluster 2024-09-21T04:59:21.758242+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: audit 2024-09-21T04:59:21.758671+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:23.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:22 smithi089 bash[26514]: cluster 2024-09-21T04:59:21.820015+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: cluster 2024-09-21T04:59:20.488352+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: cluster 2024-09-21T04:59:20.488426+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: cluster 2024-09-21T04:59:21.758070+0000 mon.a (mon.0) 627 : cluster [INF] osd.7 [v2:172.21.15.110:6824/2363981867,v1:172.21.15.110:6825/2363981867] boot 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: cluster 2024-09-21T04:59:21.758242+0000 mon.a (mon.0) 628 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: audit 2024-09-21T04:59:21.758671+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T04:59:23.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:22 smithi110 bash[22020]: cluster 2024-09-21T04:59:21.820015+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-21T04:59:24.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:23 smithi089 bash[19831]: cluster 2024-09-21T04:59:22.621105+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:24.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:23 smithi089 bash[19831]: cluster 2024-09-21T04:59:22.831077+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-21T04:59:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:23 smithi089 bash[26514]: cluster 2024-09-21T04:59:22.621105+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:23 smithi089 bash[26514]: cluster 2024-09-21T04:59:22.831077+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-21T04:59:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:23 smithi110 bash[22020]: cluster 2024-09-21T04:59:22.621105+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-21T04:59:24.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:23 smithi110 bash[22020]: cluster 2024-09-21T04:59:22.831077+0000 mon.a (mon.0) 631 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-21T04:59:25.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:24 smithi089 bash[19831]: cluster 2024-09-21T04:59:23.837484+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-21T04:59:25.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:24 smithi089 bash[26514]: cluster 2024-09-21T04:59:23.837484+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-21T04:59:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:24 smithi110 bash[22020]: cluster 2024-09-21T04:59:23.837484+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-21T04:59:25.768 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:59:26.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:25 smithi089 bash[19831]: cluster 2024-09-21T04:59:24.621639+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v308: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T04:59:26.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:25 smithi089 bash[19831]: cluster 2024-09-21T04:59:24.849562+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-21T04:59:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:25 smithi089 bash[26514]: cluster 2024-09-21T04:59:24.621639+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v308: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T04:59:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:25 smithi089 bash[26514]: cluster 2024-09-21T04:59:24.849562+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-21T04:59:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:25 smithi110 bash[22020]: cluster 2024-09-21T04:59:24.621639+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v308: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T04:59:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:25 smithi110 bash[22020]: cluster 2024-09-21T04:59:24.849562+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-21T04:59:26.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:26 smithi110 bash[22020]: cluster 2024-09-21T04:59:26.622054+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:59:27.250 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:59:27.263 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:26 smithi089 bash[19831]: cluster 2024-09-21T04:59:26.622054+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:59:27.263 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:26 smithi089 bash[26514]: cluster 2024-09-21T04:59:26.622054+0000 mgr.y (mgr.14150) 323 : cluster [DBG] pgmap v310: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-21T04:59:27.915 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1726894761,"num_in_osds":8,"osd_in_since":1726894731,"num_remapped_pgs":0} 2024-09-21T04:59:27.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:59:28.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:27 smithi089 bash[26514]: audit 2024-09-21T04:59:27.250835+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3137863876' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T04:59:28.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:27 smithi089 bash[19831]: audit 2024-09-21T04:59:27.250835+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3137863876' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T04:59:28.301 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:27 smithi110 bash[22020]: audit 2024-09-21T04:59:27.250835+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3137863876' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T04:59:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:28 smithi089 bash[19831]: cluster 2024-09-21T04:59:28.622733+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:59:29.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:28 smithi089 bash[26514]: cluster 2024-09-21T04:59:28.622733+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:59:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:28 smithi110 bash[22020]: cluster 2024-09-21T04:59:28.622733+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T04:59:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: cephadm 2024-09-21T04:59:30.142267+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:59:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.150808+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.161834+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.164163+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.165404+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.166735+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.168110+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: cephadm 2024-09-21T04:59:30.169011+0000 mgr.y (mgr.14150) 326 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4316M 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.177070+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.181423+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.183042+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: audit 2024-09-21T04:59:30.192539+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[19831]: cluster 2024-09-21T04:59:30.623316+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: cephadm 2024-09-21T04:59:30.142267+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.150808+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.161834+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.164163+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.165404+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.166735+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.168110+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: cephadm 2024-09-21T04:59:30.169011+0000 mgr.y (mgr.14150) 326 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4316M 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.177070+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.181423+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.183042+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: audit 2024-09-21T04:59:30.192539+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:31 smithi089 bash[26514]: cluster 2024-09-21T04:59:30.623316+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: cephadm 2024-09-21T04:59:30.142267+0000 mgr.y (mgr.14150) 325 : cephadm [INF] Detected new or changed devices on smithi110 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.150808+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.161834+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.164163+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.165404+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.166735+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.168110+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: cephadm 2024-09-21T04:59:30.169011+0000 mgr.y (mgr.14150) 326 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4316M 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.177070+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.181423+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:31.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.183042+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:31.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: audit 2024-09-21T04:59:30.192539+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:31.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:31 smithi110 bash[22020]: cluster 2024-09-21T04:59:30.623316+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T04:59:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:59:34.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:33 smithi089 bash[19831]: cluster 2024-09-21T04:59:32.623913+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:33 smithi089 bash[26514]: cluster 2024-09-21T04:59:32.623913+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:33 smithi110 bash[22020]: cluster 2024-09-21T04:59:32.623913+0000 mgr.y (mgr.14150) 328 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:34.111 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T04:59:34.111 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":59,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","created":"2024-09-21T04:49:45.405755+0000","modified":"2024-09-21T04:59:24.832851+0000","last_up_change":"2024-09-21T04:59:21.743498+0000","last_in_change":"2024-09-21T04:58:51.918815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T04:54:53.066224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cedd9ea3-6157-4152-a26d-369dff19cffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6803","nonce":334393973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6805","nonce":334393973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6809","nonce":334393973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6807","nonce":334393973}]},"public_addr":"172.21.15.89:6803/334393973","cluster_addr":"172.21.15.89:6805/334393973","heartbeat_back_addr":"172.21.15.89:6809/334393973","heartbeat_front_addr":"172.21.15.89:6807/334393973","state":["exists","up"]},{"osd":1,"uuid":"8f0b6d96-66a0-4fe1-a8a3-340baef4cf82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6811","nonce":542485341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6813","nonce":542485341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6817","nonce":542485341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6815","nonce":542485341}]},"public_addr":"172.21.15.89:6811/542485341","cluster_addr":"172.21.15.89:6813/542485341","heartbeat_back_addr":"172.21.15.89:6817/542485341","heartbeat_front_addr":"172.21.15.89:6815/542485341","state":["exists","up"]},{"osd":2,"uuid":"14556fdf-44d6-48ab-a2ef-8449f4a60ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6819","nonce":646968819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6821","nonce":646968819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6825","nonce":646968819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6823","nonce":646968819}]},"public_addr":"172.21.15.89:6819/646968819","cluster_addr":"172.21.15.89:6821/646968819","heartbeat_back_addr":"172.21.15.89:6825/646968819","heartbeat_front_addr":"172.21.15.89:6823/646968819","state":["exists","up"]},{"osd":3,"uuid":"588e6cd4-48b9-4090-a3bf-1c8e6be3e77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6827","nonce":1874825091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6829","nonce":1874825091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6833","nonce":1874825091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6831","nonce":1874825091}]},"public_addr":"172.21.15.89:6827/1874825091","cluster_addr":"172.21.15.89:6829/1874825091","heartbeat_back_addr":"172.21.15.89:6833/1874825091","heartbeat_front_addr":"172.21.15.89:6831/1874825091","state":["exists","up"]},{"osd":4,"uuid":"4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6801","nonce":2769401539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6803","nonce":2769401539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6807","nonce":2769401539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6805","nonce":2769401539}]},"public_addr":"172.21.15.110:6801/2769401539","cluster_addr":"172.21.15.110:6803/2769401539","heartbeat_back_addr":"172.21.15.110:6807/2769401539","heartbeat_front_addr":"172.21.15.110:6805/2769401539","state":["exists","up"]},{"osd":5,"uuid":"860b7538-f4da-4353-b0be-8d8d582f6225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6809","nonce":1758841566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6811","nonce":1758841566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6815","nonce":1758841566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6813","nonce":1758841566}]},"public_addr":"172.21.15.110:6809/1758841566","cluster_addr":"172.21.15.110:6811/1758841566","heartbeat_back_addr":"172.21.15.110:6815/1758841566","heartbeat_front_addr":"172.21.15.110:6813/1758841566","state":["exists","up"]},{"osd":6,"uuid":"dd2cbf05-398e-4f6c-a58f-ac9f7402f06f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6817","nonce":3802633513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6819","nonce":3802633513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6823","nonce":3802633513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6821","nonce":3802633513}]},"public_addr":"172.21.15.110:6817/3802633513","cluster_addr":"172.21.15.110:6819/3802633513","heartbeat_back_addr":"172.21.15.110:6823/3802633513","heartbeat_front_addr":"172.21.15.110:6821/3802633513","state":["exists","up"]},{"osd":7,"uuid":"ee200566-ff5d-4490-9bd2-0f76dae3856c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6825","nonce":2363981867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6827","nonce":2363981867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6831","nonce":2363981867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6829","nonce":2363981867}]},"public_addr":"172.21.15.110:6825/2363981867","cluster_addr":"172.21.15.110:6827/2363981867","heartbeat_back_addr":"172.21.15.110:6831/2363981867","heartbeat_front_addr":"172.21.15.110:6829/2363981867","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:00.639074+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:54.066831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:54:49.301362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:55:45.452301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:56:36.707000+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:57:30.504647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:58:24.097519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:59:20.488430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/563715280":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/2018380474":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/1007953151":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6801/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6801/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6800/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/4040295346":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1270436840":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/3989638145":"2024-09-22T04:50:12.667821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:59:34.868 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T04:54:53.066224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T04:59:34.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T04:59:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:34 smithi089 bash[19831]: audit 2024-09-21T04:59:34.110085+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.89:0/1376125947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T04:59:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:34 smithi089 bash[26514]: audit 2024-09-21T04:59:34.110085+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.89:0/1376125947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T04:59:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:34 smithi110 bash[22020]: audit 2024-09-21T04:59:34.110085+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? 172.21.15.89:0/1376125947' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T04:59:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:35 smithi089 bash[19831]: cluster 2024-09-21T04:59:34.624477+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:35 smithi089 bash[26514]: cluster 2024-09-21T04:59:34.624477+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:35 smithi110 bash[22020]: cluster 2024-09-21T04:59:34.624477+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:38.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:37 smithi089 bash[19831]: cluster 2024-09-21T04:59:36.625037+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:38.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:37 smithi089 bash[26514]: cluster 2024-09-21T04:59:36.625037+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:38.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:37 smithi110 bash[22020]: cluster 2024-09-21T04:59:36.625037+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:39.638 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:59:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:39 smithi089 bash[26514]: cluster 2024-09-21T04:59:38.625659+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:39 smithi089 bash[19831]: cluster 2024-09-21T04:59:38.625659+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:40.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:39 smithi110 bash[22020]: cluster 2024-09-21T04:59:38.625659+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:41.149 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-09-21T04:59:41.805 INFO:tasks.cephadm:Adding prometheus.a on smithi110 2024-09-21T04:59:41.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply prometheus '1;smithi110=a' 2024-09-21T04:59:42.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:41 smithi089 bash[19831]: cluster 2024-09-21T04:59:40.626241+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:41 smithi089 bash[19831]: audit 2024-09-21T04:59:41.149781+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.89:0/2505879227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T04:59:42.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:41 smithi089 bash[26514]: cluster 2024-09-21T04:59:40.626241+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:42.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:41 smithi089 bash[26514]: audit 2024-09-21T04:59:41.149781+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.89:0/2505879227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T04:59:42.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:41 smithi110 bash[22020]: cluster 2024-09-21T04:59:40.626241+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:42.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:41 smithi110 bash[22020]: audit 2024-09-21T04:59:41.149781+0000 mon.c (mon.2) 14 : audit [DBG] from='client.? 172.21.15.89:0/2505879227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T04:59:44.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:43 smithi089 bash[19831]: cluster 2024-09-21T04:59:42.626754+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:44.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:43 smithi089 bash[26514]: cluster 2024-09-21T04:59:42.626754+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:43 smithi110 bash[22020]: cluster 2024-09-21T04:59:42.626754+0000 mgr.y (mgr.14150) 333 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:45.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:44 smithi089 bash[26514]: cluster 2024-09-21T04:59:44.627334+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:45.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:44 smithi089 bash[19831]: cluster 2024-09-21T04:59:44.627334+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:45.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:44 smithi110 bash[22020]: cluster 2024-09-21T04:59:44.627334+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:46.569 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:59:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:47 smithi110 bash[22020]: cluster 2024-09-21T04:59:46.627925+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:47.853 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled prometheus update... 2024-09-21T04:59:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:47 smithi089 bash[26514]: cluster 2024-09-21T04:59:46.627925+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:47 smithi089 bash[19831]: cluster 2024-09-21T04:59:46.627925+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:48.435 DEBUG:teuthology.orchestra.run.smithi110:prometheus.a> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service 2024-09-21T04:59:48.437 INFO:tasks.cephadm:Adding node-exporter.a on smithi089 2024-09-21T04:59:48.437 INFO:tasks.cephadm:Adding node-exporter.b on smithi110 2024-09-21T04:59:48.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply node-exporter '2;smithi089=a;smithi110=b' 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:47.841205+0000 mgr.y (mgr.14150) 336 : audit [DBG] from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: cephadm 2024-09-21T04:59:47.844185+0000 mgr.y (mgr.14150) 337 : cephadm [INF] Saving service prometheus spec with placement smithi110=a;count:1 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:47.853282+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:47.855089+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:48.505969+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:48.507434+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: audit 2024-09-21T04:59:48.516783+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: cluster 2024-09-21T04:59:48.628335+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:49.264 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:48 smithi110 bash[22020]: cephadm 2024-09-21T04:59:48.815553+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T04:59:49.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:47.841205+0000 mgr.y (mgr.14150) 336 : audit [DBG] from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: cephadm 2024-09-21T04:59:47.844185+0000 mgr.y (mgr.14150) 337 : cephadm [INF] Saving service prometheus spec with placement smithi110=a;count:1 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:47.853282+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:47.855089+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:48.505969+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:48.507434+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: audit 2024-09-21T04:59:48.516783+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: cluster 2024-09-21T04:59:48.628335+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[26514]: cephadm 2024-09-21T04:59:48.815553+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:47.841205+0000 mgr.y (mgr.14150) 336 : audit [DBG] from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:49.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: cephadm 2024-09-21T04:59:47.844185+0000 mgr.y (mgr.14150) 337 : cephadm [INF] Saving service prometheus spec with placement smithi110=a;count:1 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:47.853282+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:47.855089+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:48.505969+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:48.507434+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: audit 2024-09-21T04:59:48.516783+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: cluster 2024-09-21T04:59:48.628335+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:49.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:48 smithi089 bash[19831]: cephadm 2024-09-21T04:59:48.815553+0000 mgr.y (mgr.14150) 339 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T04:59:49.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 04:59:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T04:59:52.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:51 smithi089 bash[26514]: cluster 2024-09-21T04:59:50.628848+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:51 smithi089 bash[19831]: cluster 2024-09-21T04:59:50.628848+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:51 smithi110 bash[22020]: cluster 2024-09-21T04:59:50.628848+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:53.230 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:59:54.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:53 smithi089 bash[26514]: cluster 2024-09-21T04:59:52.629416+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:53 smithi089 bash[19831]: cluster 2024-09-21T04:59:52.629416+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:53 smithi110 bash[22020]: cluster 2024-09-21T04:59:52.629416+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:56.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:55 smithi089 bash[26514]: cluster 2024-09-21T04:59:54.629996+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:55 smithi089 bash[19831]: cluster 2024-09-21T04:59:54.629996+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:55 smithi110 bash[22020]: cluster 2024-09-21T04:59:54.629996+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:57.088 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled node-exporter update... 2024-09-21T04:59:58.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:57 smithi089 bash[26514]: cluster 2024-09-21T04:59:56.630560+0000 mgr.y (mgr.14150) 343 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:58.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:57 smithi089 bash[26514]: audit 2024-09-21T04:59:57.088185+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:57 smithi089 bash[19831]: cluster 2024-09-21T04:59:56.630560+0000 mgr.y (mgr.14150) 343 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:57 smithi089 bash[19831]: audit 2024-09-21T04:59:57.088185+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:57 smithi110 bash[22020]: cluster 2024-09-21T04:59:56.630560+0000 mgr.y (mgr.14150) 343 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T04:59:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:57 smithi110 bash[22020]: audit 2024-09-21T04:59:57.088185+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T04:59:58.154 DEBUG:teuthology.orchestra.run.smithi089:node-exporter.a> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.a.service 2024-09-21T04:59:58.157 DEBUG:teuthology.orchestra.run.smithi110:node-exporter.b> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.b.service 2024-09-21T04:59:58.160 INFO:tasks.cephadm:Adding alertmanager.a on smithi089 2024-09-21T04:59:58.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply alertmanager '1;smithi089=a' 2024-09-21T04:59:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:58 smithi089 bash[19831]: audit 2024-09-21T04:59:57.077939+0000 mgr.y (mgr.14150) 344 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi089=a;smithi110=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:58 smithi089 bash[19831]: cephadm 2024-09-21T04:59:57.081005+0000 mgr.y (mgr.14150) 345 : cephadm [INF] Saving service node-exporter spec with placement smithi089=a;smithi110=b;count:2 2024-09-21T04:59:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:58 smithi089 bash[26514]: audit 2024-09-21T04:59:57.077939+0000 mgr.y (mgr.14150) 344 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi089=a;smithi110=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:58 smithi089 bash[26514]: cephadm 2024-09-21T04:59:57.081005+0000 mgr.y (mgr.14150) 345 : cephadm [INF] Saving service node-exporter spec with placement smithi089=a;smithi110=b;count:2 2024-09-21T04:59:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:58 smithi110 bash[22020]: audit 2024-09-21T04:59:57.077939+0000 mgr.y (mgr.14150) 344 : audit [DBG] from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi089=a;smithi110=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:59:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:58 smithi110 bash[22020]: cephadm 2024-09-21T04:59:57.081005+0000 mgr.y (mgr.14150) 345 : cephadm [INF] Saving service node-exporter spec with placement smithi089=a;smithi110=b;count:2 2024-09-21T05:00:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 04:59:59 smithi089 bash[19831]: cluster 2024-09-21T04:59:58.631270+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:00.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 04:59:59 smithi089 bash[26514]: cluster 2024-09-21T04:59:58.631270+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 04:59:59 smithi110 bash[22020]: cluster 2024-09-21T04:59:58.631270+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:00 smithi110 bash[22020]: cluster 2024-09-21T05:00:00.000159+0000 mon.a (mon.0) 650 : cluster [INF] overall HEALTH_OK 2024-09-21T05:00:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:00 smithi089 bash[19831]: cluster 2024-09-21T05:00:00.000159+0000 mon.a (mon.0) 650 : cluster [INF] overall HEALTH_OK 2024-09-21T05:00:01.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:00 smithi089 bash[26514]: cluster 2024-09-21T05:00:00.000159+0000 mon.a (mon.0) 650 : cluster [INF] overall HEALTH_OK 2024-09-21T05:00:02.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:01 smithi089 bash[19831]: cluster 2024-09-21T05:00:00.631980+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:02.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:01 smithi089 bash[26514]: cluster 2024-09-21T05:00:00.631980+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:01 smithi110 bash[22020]: cluster 2024-09-21T05:00:00.631980+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:03.241 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.241 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.241 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.242 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.242 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.242 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.356 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:00:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.555 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:03.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:03 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:00:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[19831]: cluster 2024-09-21T05:00:02.632682+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[19831]: audit 2024-09-21T05:00:03.543481+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[19831]: audit 2024-09-21T05:00:03.556309+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[19831]: audit 2024-09-21T05:00:03.568547+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[19831]: audit 2024-09-21T05:00:03.573259+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[26514]: cluster 2024-09-21T05:00:02.632682+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[26514]: audit 2024-09-21T05:00:03.543481+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[26514]: audit 2024-09-21T05:00:03.556309+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[26514]: audit 2024-09-21T05:00:03.568547+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:03 smithi089 bash[26514]: audit 2024-09-21T05:00:03.573259+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T05:00:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 bash[22020]: cluster 2024-09-21T05:00:02.632682+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 bash[22020]: audit 2024-09-21T05:00:03.543481+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 bash[22020]: audit 2024-09-21T05:00:03.556309+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 bash[22020]: audit 2024-09-21T05:00:03.568547+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' 2024-09-21T05:00:04.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:03 smithi110 bash[22020]: audit 2024-09-21T05:00:03.573259+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T05:00:05.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:04 smithi089 bash[20084]: ignoring --setuser ceph since I am not root 2024-09-21T05:00:05.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:04 smithi089 bash[20084]: ignoring --setgroup ceph since I am not root 2024-09-21T05:00:05.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:04 smithi089 bash[20084]: debug 2024-09-21T05:00:04.737+0000 7f413ab52040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T05:00:05.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:04 smithi110 bash[22903]: ignoring --setuser ceph since I am not root 2024-09-21T05:00:05.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:04 smithi110 bash[22903]: ignoring --setgroup ceph since I am not root 2024-09-21T05:00:05.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:04 smithi110 bash[22903]: debug 2024-09-21T05:00:04.657+0000 7f4506fe0640 1 -- 172.21.15.110:0/580081964 <== mon.2 v2:172.21.15.89:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e1a96d0e0 con 0x561e1a96f800 2024-09-21T05:00:05.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:04 smithi110 bash[22903]: debug 2024-09-21T05:00:04.769+0000 7f450983c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T05:00:05.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.230Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:00:05.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.230Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:00:05.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.230Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:00:05.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.230Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.230Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.231Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.231Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.235Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.235Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.237Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.237Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.372µs 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.237Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.237Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.237Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.092µs wal_replay_duration=281.701µs wbl_replay_duration=117ns total_replay_duration=322.873µs 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.238Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.238Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.238Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.239Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:00:05.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.239Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:00:05.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.239Z caller=refresh.go:80 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:00:05.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.263Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.74435ms db_storage=850ns remote_storage=1.119µs web_handler=298ns query_engine=705ns scrape=232.558µs scrape_sd=86.798µs notify=792ns notify_sd=1.495µs rules=24.047254ms tracing=7.71µs 2024-09-21T05:00:05.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.263Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:00:05.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[45748]: ts=2024-09-21T05:00:05.263Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:00:05.922 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[26514]: audit 2024-09-21T05:00:04.568149+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T05:00:05.922 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[26514]: cluster 2024-09-21T05:00:04.582415+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-21T05:00:05.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[19831]: audit 2024-09-21T05:00:04.568149+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T05:00:05.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[19831]: cluster 2024-09-21T05:00:04.582415+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-21T05:00:06.012 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[22020]: audit 2024-09-21T05:00:04.568149+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.89:0/2523875540' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T05:00:06.013 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:05 smithi110 bash[22020]: cluster 2024-09-21T05:00:04.582415+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-21T05:00:06.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[20084]: debug 2024-09-21T05:00:05.917+0000 7f413ab52040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T05:00:06.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:05 smithi089 bash[20084]: debug 2024-09-21T05:00:05.981+0000 7f413ab52040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T05:00:06.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:06 smithi089 bash[20084]: debug 2024-09-21T05:00:06.133+0000 7f413ab52040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T05:00:06.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:06 smithi110 bash[22903]: debug 2024-09-21T05:00:06.009+0000 7f450983c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T05:00:06.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:06 smithi110 bash[22903]: debug 2024-09-21T05:00:06.073+0000 7f450983c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T05:00:06.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:06 smithi110 bash[22903]: debug 2024-09-21T05:00:06.225+0000 7f450983c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T05:00:07.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:06 smithi089 bash[20084]: debug 2024-09-21T05:00:06.777+0000 7f413ab52040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T05:00:07.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:06 smithi089 bash[20084]: debug 2024-09-21T05:00:06.845+0000 7f413ab52040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T05:00:07.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:06 smithi089 bash[20084]: debug 2024-09-21T05:00:06.913+0000 7f413ab52040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T05:00:07.194 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:06 smithi110 bash[22903]: debug 2024-09-21T05:00:06.869+0000 7f450983c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T05:00:07.195 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:06 smithi110 bash[22903]: debug 2024-09-21T05:00:06.937+0000 7f450983c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T05:00:07.195 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.005+0000 7f450983c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T05:00:07.500 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.097+0000 7f413ab52040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T05:00:07.501 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.173+0000 7f413ab52040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T05:00:07.501 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.241+0000 7f413ab52040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T05:00:07.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.189+0000 7f450983c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T05:00:07.555 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.269+0000 7f450983c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T05:00:07.555 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.337+0000 7f450983c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T05:00:07.763 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.493+0000 7f413ab52040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T05:00:07.763 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.561+0000 7f413ab52040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T05:00:07.856 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.589+0000 7f450983c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T05:00:07.856 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.657+0000 7f450983c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T05:00:07.856 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.853+0000 7f450983c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T05:00:08.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.757+0000 7f413ab52040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T05:00:08.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:07 smithi089 bash[20084]: debug 2024-09-21T05:00:07.833+0000 7f413ab52040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T05:00:08.180 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:07 smithi110 bash[22903]: debug 2024-09-21T05:00:07.929+0000 7f450983c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T05:00:08.424 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:08 smithi089 bash[20084]: debug 2024-09-21T05:00:08.081+0000 7f413ab52040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T05:00:08.424 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:08 smithi089 bash[20084]: debug 2024-09-21T05:00:08.257+0000 7f413ab52040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:00:08.518 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:08 smithi110 bash[22903]: debug 2024-09-21T05:00:08.177+0000 7f450983c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T05:00:08.518 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:08 smithi110 bash[22903]: debug 2024-09-21T05:00:08.353+0000 7f450983c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:00:08.679 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:08 smithi089 bash[20084]: debug 2024-09-21T05:00:08.417+0000 7f413ab52040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T05:00:08.679 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:08 smithi089 bash[20084]: debug 2024-09-21T05:00:08.497+0000 7f413ab52040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T05:00:08.775 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:08 smithi110 bash[22903]: debug 2024-09-21T05:00:08.513+0000 7f450983c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T05:00:08.775 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:08 smithi110 bash[22903]: debug 2024-09-21T05:00:08.593+0000 7f450983c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T05:00:09.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:08 smithi089 bash[20084]: debug 2024-09-21T05:00:08.673+0000 7f413ab52040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:00:09.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:08 smithi110 bash[22903]: debug 2024-09-21T05:00:08.769+0000 7f450983c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:00:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:09 smithi089 bash[20084]: debug 2024-09-21T05:00:09.497+0000 7f413ab52040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T05:00:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:09 smithi089 bash[20084]: debug 2024-09-21T05:00:09.573+0000 7f413ab52040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T05:00:09.875 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:09 smithi110 bash[22903]: debug 2024-09-21T05:00:09.573+0000 7f450983c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T05:00:09.875 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:09 smithi110 bash[22903]: debug 2024-09-21T05:00:09.649+0000 7f450983c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T05:00:10.258 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:09 smithi089 bash[20084]: debug 2024-09-21T05:00:09.793+0000 7f413ab52040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T05:00:10.258 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:09 smithi089 bash[20084]: debug 2024-09-21T05:00:09.865+0000 7f413ab52040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T05:00:10.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:09 smithi110 bash[22903]: debug 2024-09-21T05:00:09.869+0000 7f450983c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T05:00:10.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:09 smithi110 bash[22903]: debug 2024-09-21T05:00:09.945+0000 7f450983c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: debug 2024-09-21T05:00:10.253+0000 7f413ab52040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: debug 2024-09-21T05:00:10.329+0000 7f413ab52040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: [21/Sep/2024:05:00:10] ENGINE Bus STARTING 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: CherryPy Checker: 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: The Application mounted at '' has an empty config. 2024-09-21T05:00:10.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.359856+0000 mon.a (mon.0) 657 : cluster [INF] Active manager daemon y restarted 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.360409+0000 mon.a (mon.0) 658 : cluster [INF] Activating manager daemon y 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.375512+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.376074+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0158473s), standbys: x 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.378102+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.378445+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.378800+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.380353+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:00:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.380884+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.381382+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.382043+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.382288+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.382611+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.382949+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.383300+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.383617+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.383941+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.384273+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.384497+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:00:10.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[19831]: audit 2024-09-21T05:00:10.385041+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.359856+0000 mon.a (mon.0) 657 : cluster [INF] Active manager daemon y restarted 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.360409+0000 mon.a (mon.0) 658 : cluster [INF] Activating manager daemon y 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.375512+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.376074+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0158473s), standbys: x 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.378102+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.378445+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.378800+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.380353+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:00:10.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.380884+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.381382+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.382043+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.382288+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.382611+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.382949+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.383300+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.383617+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.383941+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.384273+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.384497+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:00:10.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[26514]: audit 2024-09-21T05:00:10.385041+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:00:10.649 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: debug 2024-09-21T05:00:10.333+0000 7f450983c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: debug 2024-09-21T05:00:10.417+0000 7f450983c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: [21/Sep/2024:05:00:10] ENGINE Bus STARTING 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: CherryPy Checker: 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: The Application mounted at '' has an empty config. 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: [21/Sep/2024:05:00:10] ENGINE Serving on http://:::9283 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22903]: [21/Sep/2024:05:00:10] ENGINE Bus STARTED 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.359856+0000 mon.a (mon.0) 657 : cluster [INF] Active manager daemon y restarted 2024-09-21T05:00:10.650 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.360409+0000 mon.a (mon.0) 658 : cluster [INF] Activating manager daemon y 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.375512+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.376074+0000 mon.a (mon.0) 660 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0158473s), standbys: x 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.378102+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.378445+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.378800+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.380353+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.380884+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.381382+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.382043+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.382288+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.382611+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.382949+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.383300+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:00:10.651 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.383617+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:00:10.652 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.383941+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:00:10.652 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.384273+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:00:10.652 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.384497+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:00:10.652 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:10 smithi110 bash[22020]: audit 2024-09-21T05:00:10.385041+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:00:11.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: [21/Sep/2024:05:00:10] ENGINE Serving on http://:::9283 2024-09-21T05:00:11.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:10 smithi089 bash[20084]: [21/Sep/2024:05:00:10] ENGINE Bus STARTED 2024-09-21T05:00:11.389 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled alertmanager update... 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.412803+0000 mon.a (mon.0) 661 : cluster [INF] Manager daemon y is now available 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.437126+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.441487+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: cluster 2024-09-21T05:00:10.441618+0000 mon.a (mon.0) 663 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.446164+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.447967+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:00:11.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.450318+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.451198+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.453877+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.458790+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.466258+0000 mon.c (mon.2) 37 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.466675+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.479665+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:10.480061+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: cluster 2024-09-21T05:00:11.374709+0000 mon.a (mon.0) 667 : cluster [DBG] mgrmap e18: y(active, since 1.01448s), standbys: x 2024-09-21T05:00:11.680 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[19831]: audit 2024-09-21T05:00:11.389532+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.412803+0000 mon.a (mon.0) 661 : cluster [INF] Manager daemon y is now available 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.437126+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.441487+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: cluster 2024-09-21T05:00:10.441618+0000 mon.a (mon.0) 663 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.446164+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.447967+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.450318+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.451198+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.453877+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.458790+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.466258+0000 mon.c (mon.2) 37 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.466675+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.681 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.479665+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.682 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:10.480061+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.682 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: cluster 2024-09-21T05:00:11.374709+0000 mon.a (mon.0) 667 : cluster [DBG] mgrmap e18: y(active, since 1.01448s), standbys: x 2024-09-21T05:00:11.682 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[26514]: audit 2024-09-21T05:00:11.389532+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.412803+0000 mon.a (mon.0) 661 : cluster [INF] Manager daemon y is now available 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.437126+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.441487+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: cluster 2024-09-21T05:00:10.441618+0000 mon.a (mon.0) 663 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.446164+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.447967+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.450318+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.451198+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1662400889' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:00:11.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.453877+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.458790+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.466258+0000 mon.c (mon.2) 37 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.466675+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.479665+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:10.480061+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: cluster 2024-09-21T05:00:11.374709+0000 mon.a (mon.0) 667 : cluster [DBG] mgrmap e18: y(active, since 1.01448s), standbys: x 2024-09-21T05:00:11.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:11 smithi110 bash[22020]: audit 2024-09-21T05:00:11.389532+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:12.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: debug 2024-09-21T05:00:11.673+0000 7f4091b41640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:00:11] ENGINE Error in HTTPServer.serve 2024-09-21T05:00:12.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: Traceback (most recent call last): 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: self._connections.run(self.expiration_interval) 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: self._run(expiration_interval) 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: s = self.context.wrap_socket( 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: return self.sslsocket_class._create( 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: self.do_handshake() 2024-09-21T05:00:12.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:00:12.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: self._sslobj.do_handshake() 2024-09-21T05:00:12.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:11 smithi089 bash[20084]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:00:12.114 DEBUG:teuthology.orchestra.run.smithi089:alertmanager.a> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@alertmanager.a.service 2024-09-21T05:00:12.117 INFO:tasks.cephadm:Adding grafana.a on smithi110 2024-09-21T05:00:12.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph orch apply grafana '1;smithi110=a' 2024-09-21T05:00:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.385868+0000 mgr.y (mgr.14385) 2 : cephadm [INF] Saving service alertmanager spec with placement smithi089=a;count:1 2024-09-21T05:00:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[19831]: cluster 2024-09-21T05:00:11.386999+0000 mgr.y (mgr.14385) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.456650+0000 mgr.y (mgr.14385) 4 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTING 2024-09-21T05:00:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.558417+0000 mgr.y (mgr.14385) 5 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:00:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.385868+0000 mgr.y (mgr.14385) 2 : cephadm [INF] Saving service alertmanager spec with placement smithi089=a;count:1 2024-09-21T05:00:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[26514]: cluster 2024-09-21T05:00:11.386999+0000 mgr.y (mgr.14385) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.456650+0000 mgr.y (mgr.14385) 4 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTING 2024-09-21T05:00:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:12 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.558417+0000 mgr.y (mgr.14385) 5 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:00:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:12 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.385868+0000 mgr.y (mgr.14385) 2 : cephadm [INF] Saving service alertmanager spec with placement smithi089=a;count:1 2024-09-21T05:00:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:12 smithi110 bash[22020]: cluster 2024-09-21T05:00:11.386999+0000 mgr.y (mgr.14385) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:12 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.456650+0000 mgr.y (mgr.14385) 4 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTING 2024-09-21T05:00:12.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:12 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.558417+0000 mgr.y (mgr.14385) 5 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.677702+0000 mgr.y (mgr.14385) 6 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.677899+0000 mgr.y (mgr.14385) 7 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTED 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: cephadm 2024-09-21T05:00:11.679563+0000 mgr.y (mgr.14385) 8 : cephadm [ERR] [21/Sep/2024:05:00:11] ENGINE Error in HTTPServer.serve 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:00:13.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: self.do_handshake() 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:00:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: cluster 2024-09-21T05:00:12.381920+0000 mgr.y (mgr.14385) 9 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[19831]: cluster 2024-09-21T05:00:12.437391+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e19: y(active, since 2s), standbys: x 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.677702+0000 mgr.y (mgr.14385) 6 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.677899+0000 mgr.y (mgr.14385) 7 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTED 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: cephadm 2024-09-21T05:00:11.679563+0000 mgr.y (mgr.14385) 8 : cephadm [ERR] [21/Sep/2024:05:00:11] ENGINE Error in HTTPServer.serve 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: Traceback (most recent call last): 2024-09-21T05:00:13.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: self._connections.run(self.expiration_interval) 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: self._run(expiration_interval) 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: s = self.context.wrap_socket( 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: return self.sslsocket_class._create( 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: self.do_handshake() 2024-09-21T05:00:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:00:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: self._sslobj.do_handshake() 2024-09-21T05:00:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:00:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: cluster 2024-09-21T05:00:12.381920+0000 mgr.y (mgr.14385) 9 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:13 smithi089 bash[26514]: cluster 2024-09-21T05:00:12.437391+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e19: y(active, since 2s), standbys: x 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.677702+0000 mgr.y (mgr.14385) 6 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.677899+0000 mgr.y (mgr.14385) 7 : cephadm [INF] [21/Sep/2024:05:00:11] ENGINE Bus STARTED 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: cephadm 2024-09-21T05:00:11.679563+0000 mgr.y (mgr.14385) 8 : cephadm [ERR] [21/Sep/2024:05:00:11] ENGINE Error in HTTPServer.serve 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: Traceback (most recent call last): 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: self._connections.run(self.expiration_interval) 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:00:13.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: self._run(expiration_interval) 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: s = self.context.wrap_socket( 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: return self.sslsocket_class._create( 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: self.do_handshake() 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: self._sslobj.do_handshake() 2024-09-21T05:00:13.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:00:13.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: cluster 2024-09-21T05:00:12.381920+0000 mgr.y (mgr.14385) 9 : cluster [DBG] pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:13.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:13 smithi110 bash[22020]: cluster 2024-09-21T05:00:12.437391+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e19: y(active, since 2s), standbys: x 2024-09-21T05:00:15.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:15 smithi089 bash[19831]: cluster 2024-09-21T05:00:14.382457+0000 mgr.y (mgr.14385) 10 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:15.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:15 smithi089 bash[19831]: cluster 2024-09-21T05:00:14.450662+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e20: y(active, since 4s), standbys: x 2024-09-21T05:00:15.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:15 smithi089 bash[26514]: cluster 2024-09-21T05:00:14.382457+0000 mgr.y (mgr.14385) 10 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:15.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:15 smithi089 bash[26514]: cluster 2024-09-21T05:00:14.450662+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e20: y(active, since 4s), standbys: x 2024-09-21T05:00:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:15 smithi110 bash[22020]: cluster 2024-09-21T05:00:14.382457+0000 mgr.y (mgr.14385) 10 : cluster [DBG] pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:15 smithi110 bash[22020]: cluster 2024-09-21T05:00:14.450662+0000 mon.a (mon.0) 670 : cluster [DBG] mgrmap e20: y(active, since 4s), standbys: x 2024-09-21T05:00:16.017 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:00:17.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:17 smithi110 bash[22020]: audit 2024-09-21T05:00:16.277188+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:17 smithi110 bash[22020]: audit 2024-09-21T05:00:16.282530+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:17 smithi110 bash[22020]: cluster 2024-09-21T05:00:16.383091+0000 mgr.y (mgr.14385) 11 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T05:00:17.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:17 smithi110 bash[22020]: audit 2024-09-21T05:00:16.451740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:17 smithi110 bash[22020]: audit 2024-09-21T05:00:16.463568+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.402 INFO:teuthology.orchestra.run.smithi110.stdout:Scheduled grafana update... 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[19831]: audit 2024-09-21T05:00:16.277188+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[19831]: audit 2024-09-21T05:00:16.282530+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[19831]: cluster 2024-09-21T05:00:16.383091+0000 mgr.y (mgr.14385) 11 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[19831]: audit 2024-09-21T05:00:16.451740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[19831]: audit 2024-09-21T05:00:16.463568+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[26514]: audit 2024-09-21T05:00:16.277188+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[26514]: audit 2024-09-21T05:00:16.282530+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[26514]: cluster 2024-09-21T05:00:16.383091+0000 mgr.y (mgr.14385) 11 : cluster [DBG] pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-21T05:00:17.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[26514]: audit 2024-09-21T05:00:16.451740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:17.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:17 smithi089 bash[26514]: audit 2024-09-21T05:00:16.463568+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.062 DEBUG:teuthology.orchestra.run.smithi110:grafana.a> sudo journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@grafana.a.service 2024-09-21T05:00:18.066 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T05:00:18.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T05:00:18.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.393743+0000 mgr.y (mgr.14385) 12 : audit [DBG] from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.395524+0000 mgr.y (mgr.14385) 13 : cephadm [INF] Saving service grafana spec with placement smithi110=a;count:1 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.400155+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.424607+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.433326+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.663172+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.676714+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.680609+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.681236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.683096+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.683755+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.685478+0000 mon.c (mon.2) 41 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.686121+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.687898+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.688555+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.700490+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.706879+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:17.708703+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:18.291765+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:18.296620+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:18.316983+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:18.325750+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[19831]: audit 2024-09-21T05:00:18.334672+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.393743+0000 mgr.y (mgr.14385) 12 : audit [DBG] from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:18.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.395524+0000 mgr.y (mgr.14385) 13 : cephadm [INF] Saving service grafana spec with placement smithi110=a;count:1 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.400155+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.424607+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.433326+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.663172+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.676714+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.680609+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.681236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.683096+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.683755+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.685478+0000 mon.c (mon.2) 41 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.686121+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.687898+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.688555+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.700490+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.706879+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:17.708703+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:18.291765+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:18.296620+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:18.316983+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:18.325750+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:18 smithi089 bash[26514]: audit 2024-09-21T05:00:18.334672+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.393743+0000 mgr.y (mgr.14385) 12 : audit [DBG] from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi110=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.395524+0000 mgr.y (mgr.14385) 13 : cephadm [INF] Saving service grafana spec with placement smithi110=a;count:1 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.400155+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.424607+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.433326+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.663172+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.676714+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.680609+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.681236+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.683096+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.683755+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.685478+0000 mon.c (mon.2) 41 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.686121+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.687898+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.688555+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.700490+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.706879+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:17.708703+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:18.291765+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:18.296620+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:18.316983+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:18.325750+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:18.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:18 smithi110 bash[22020]: audit 2024-09-21T05:00:18.334672+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:19.394 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.394 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.395 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.395 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.395 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.395 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.395 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.396 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.396 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.396 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.396 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.396 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.397 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: Started Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:00:19.397 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.397 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:00:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:19.796 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[49908]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-21T05:00:19.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.690013+0000 mgr.y (mgr.14385) 14 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4060M 2024-09-21T05:00:19.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.711188+0000 mgr.y (mgr.14385) 15 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.711968+0000 mgr.y (mgr.14385) 16 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.902479+0000 mgr.y (mgr.14385) 17 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:17.905560+0000 mgr.y (mgr.14385) 18 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:18.030829+0000 mgr.y (mgr.14385) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:18.043932+0000 mgr.y (mgr.14385) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:18.163030+0000 mgr.y (mgr.14385) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:18.177755+0000 mgr.y (mgr.14385) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cephadm 2024-09-21T05:00:18.337461+0000 mgr.y (mgr.14385) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[26514]: cluster 2024-09-21T05:00:18.383690+0000 mgr.y (mgr.14385) 24 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-21T05:00:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.690013+0000 mgr.y (mgr.14385) 14 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4060M 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.711188+0000 mgr.y (mgr.14385) 15 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.711968+0000 mgr.y (mgr.14385) 16 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.902479+0000 mgr.y (mgr.14385) 17 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:17.905560+0000 mgr.y (mgr.14385) 18 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:18.030829+0000 mgr.y (mgr.14385) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:18.043932+0000 mgr.y (mgr.14385) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:18.163030+0000 mgr.y (mgr.14385) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:18.177755+0000 mgr.y (mgr.14385) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cephadm 2024-09-21T05:00:18.337461+0000 mgr.y (mgr.14385) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:00:19.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[19831]: cluster 2024-09-21T05:00:18.383690+0000 mgr.y (mgr.14385) 24 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-21T05:00:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.690013+0000 mgr.y (mgr.14385) 14 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 4060M 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.711188+0000 mgr.y (mgr.14385) 15 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.711968+0000 mgr.y (mgr.14385) 16 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.902479+0000 mgr.y (mgr.14385) 17 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:17.905560+0000 mgr.y (mgr.14385) 18 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:18.030829+0000 mgr.y (mgr.14385) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:18.043932+0000 mgr.y (mgr.14385) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:18.163030+0000 mgr.y (mgr.14385) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:18.177755+0000 mgr.y (mgr.14385) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cephadm 2024-09-21T05:00:18.337461+0000 mgr.y (mgr.14385) 23 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:00:19.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:19 smithi110 bash[22020]: cluster 2024-09-21T05:00:18.383690+0000 mgr.y (mgr.14385) 24 : cluster [DBG] pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-21T05:00:20.238 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.239 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.239 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.239 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.240 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.240 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.240 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.241 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:19 smithi089 bash[49908]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-21T05:00:20.494 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[19831]: audit 2024-09-21T05:00:19.438134+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.494 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[19831]: audit 2024-09-21T05:00:19.443033+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.494 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[19831]: audit 2024-09-21T05:00:19.447372+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.494 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[19831]: cephadm 2024-09-21T05:00:19.448207+0000 mgr.y (mgr.14385) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:00:20.495 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[26514]: audit 2024-09-21T05:00:19.438134+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.495 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[26514]: audit 2024-09-21T05:00:19.443033+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.495 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[26514]: audit 2024-09-21T05:00:19.447372+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.495 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[26514]: cephadm 2024-09-21T05:00:19.448207+0000 mgr.y (mgr.14385) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:00:20.495 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 22b70bddd3ac: Pulling fs layer 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 5c12815fee55: Pulling fs layer 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: c0e87333d380: Pulling fs layer 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 5c12815fee55: Verifying Checksum 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 22b70bddd3ac: Verifying Checksum 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 22b70bddd3ac: Download complete 2024-09-21T05:00:20.496 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: c0e87333d380: Verifying Checksum 2024-09-21T05:00:20.503 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.504 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.504 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.504 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.505 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.505 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: Started Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:00:20.506 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.506 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 bash[22020]: audit 2024-09-21T05:00:19.438134+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.506 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 bash[22020]: audit 2024-09-21T05:00:19.443033+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.506 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 bash[22020]: audit 2024-09-21T05:00:19.447372+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:20.506 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:20 smithi110 bash[22020]: cephadm 2024-09-21T05:00:19.448207+0000 mgr.y (mgr.14385) 25 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:00:20.507 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:20.795 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: c0e87333d380: Download complete 2024-09-21T05:00:20.796 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:20 smithi089 bash[49908]: 22b70bddd3ac: Pull complete 2024-09-21T05:00:20.804 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:20 smithi110 bash[46531]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-21T05:00:21.304 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-21T05:00:21.508 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[49908]: 5c12815fee55: Pull complete 2024-09-21T05:00:21.509 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:21 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:21.615 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 22b70bddd3ac: Pulling fs layer 2024-09-21T05:00:21.615 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 5c12815fee55: Pulling fs layer 2024-09-21T05:00:21.615 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: c0e87333d380: Pulling fs layer 2024-09-21T05:00:21.615 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 5c12815fee55: Verifying Checksum 2024-09-21T05:00:21.616 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 5c12815fee55: Download complete 2024-09-21T05:00:21.616 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 22b70bddd3ac: Verifying Checksum 2024-09-21T05:00:21.616 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 22b70bddd3ac: Download complete 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: cluster 2024-09-21T05:00:20.384313+0000 mgr.y (mgr.14385) 26 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: audit 2024-09-21T05:00:20.510134+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: audit 2024-09-21T05:00:20.517114+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: audit 2024-09-21T05:00:20.523463+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: audit 2024-09-21T05:00:20.531293+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: audit 2024-09-21T05:00:20.543884+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.616 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[22020]: cephadm 2024-09-21T05:00:20.557754+0000 mgr.y (mgr.14385) 27 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:00:21.796 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[49908]: c0e87333d380: Pull complete 2024-09-21T05:00:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: cluster 2024-09-21T05:00:20.384313+0000 mgr.y (mgr.14385) 26 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: audit 2024-09-21T05:00:20.510134+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: audit 2024-09-21T05:00:20.517114+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: audit 2024-09-21T05:00:20.523463+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: audit 2024-09-21T05:00:20.531293+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: audit 2024-09-21T05:00:20.543884+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[19831]: cephadm 2024-09-21T05:00:20.557754+0000 mgr.y (mgr.14385) 27 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: cluster 2024-09-21T05:00:20.384313+0000 mgr.y (mgr.14385) 26 : cluster [DBG] pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: audit 2024-09-21T05:00:20.510134+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: audit 2024-09-21T05:00:20.517114+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: audit 2024-09-21T05:00:20.523463+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: audit 2024-09-21T05:00:20.531293+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: audit 2024-09-21T05:00:20.543884+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[26514]: cephadm 2024-09-21T05:00:20.557754+0000 mgr.y (mgr.14385) 27 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:00:22.054 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: c0e87333d380: Verifying Checksum 2024-09-21T05:00:22.054 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: c0e87333d380: Download complete 2024-09-21T05:00:22.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:21 smithi110 bash[46531]: 22b70bddd3ac: Pull complete 2024-09-21T05:00:22.255 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[49908]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-21T05:00:22.255 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:21 smithi089 bash[49908]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-21T05:00:22.804 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:22 smithi110 bash[46531]: 5c12815fee55: Pull complete 2024-09-21T05:00:22.818 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:00:23.228 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:22 smithi110 bash[46531]: c0e87333d380: Pull complete 2024-09-21T05:00:23.228 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:23 smithi110 bash[46531]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-21T05:00:23.228 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:23 smithi110 bash[46531]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-21T05:00:23.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:23 smithi089 bash[19831]: cluster 2024-09-21T05:00:22.385048+0000 mgr.y (mgr.14385) 28 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:00:23.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:23 smithi089 bash[26514]: cluster 2024-09-21T05:00:22.385048+0000 mgr.y (mgr.14385) 28 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:00:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:23 smithi110 bash[22020]: cluster 2024-09-21T05:00:22.385048+0000 mgr.y (mgr.14385) 28 : cluster [DBG] pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T05:00:25.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.702Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-21T05:00:25.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.702Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-21T05:00:25.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.703Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.703Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.703Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.703Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T05:00:25.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T05:00:25.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T05:00:25.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-21T05:00:25.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:24 smithi110 bash[46531]: ts=2024-09-21T05:00:24.704Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T05:00:25.296 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.092Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-21T05:00:25.296 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.092Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-21T05:00:25.296 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.093Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T05:00:25.296 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.093Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.093Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.093Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T05:00:25.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T05:00:25.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T05:00:25.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.094Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.095Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-21T05:00:25.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[49908]: ts=2024-09-21T05:00:25.095Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T05:00:25.634 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-21T05:00:25.634 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDpUu5mXxS8JRAA2uMdSK58rKyOIRDfL6aIog== 2024-09-21T05:00:25.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[26514]: cluster 2024-09-21T05:00:24.385668+0000 mgr.y (mgr.14385) 29 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:25.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[26514]: audit 2024-09-21T05:00:25.457487+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:25.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[26514]: audit 2024-09-21T05:00:25.462694+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[19831]: cluster 2024-09-21T05:00:24.385668+0000 mgr.y (mgr.14385) 29 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[19831]: audit 2024-09-21T05:00:25.457487+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:25 smithi089 bash[19831]: audit 2024-09-21T05:00:25.462694+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:25 smithi110 bash[22020]: cluster 2024-09-21T05:00:24.385668+0000 mgr.y (mgr.14385) 29 : cluster [DBG] pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:25 smithi110 bash[22020]: audit 2024-09-21T05:00:25.457487+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:25 smithi110 bash[22020]: audit 2024-09-21T05:00:25.462694+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:26 smithi089 bash[19831]: audit 2024-09-21T05:00:25.632825+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:26 smithi089 bash[19831]: audit 2024-09-21T05:00:25.635256+0000 mon.a (mon.0) 700 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:26.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:26 smithi089 bash[26514]: audit 2024-09-21T05:00:25.632825+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:26.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:26 smithi089 bash[26514]: audit 2024-09-21T05:00:25.635256+0000 mon.a (mon.0) 700 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:26 smithi110 bash[22020]: audit 2024-09-21T05:00:25.632825+0000 mon.a (mon.0) 699 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:26 smithi110 bash[22020]: audit 2024-09-21T05:00:25.635256+0000 mon.a (mon.0) 700 : audit [INF] from='client.? 172.21.15.89:0/179827312' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:27.047 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T05:00:27.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T05:00:27.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T05:00:27.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T05:00:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:27 smithi089 bash[19831]: cluster 2024-09-21T05:00:26.386248+0000 mgr.y (mgr.14385) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:28.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:27 smithi089 bash[26514]: cluster 2024-09-21T05:00:26.386248+0000 mgr.y (mgr.14385) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:27 smithi110 bash[22020]: cluster 2024-09-21T05:00:26.386248+0000 mgr.y (mgr.14385) 30 : cluster [DBG] pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T05:00:29.814 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:29 smithi089 bash[26514]: cluster 2024-09-21T05:00:28.386869+0000 mgr.y (mgr.14385) 31 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:29.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:29 smithi089 bash[19831]: cluster 2024-09-21T05:00:28.386869+0000 mgr.y (mgr.14385) 31 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:29 smithi110 bash[22020]: cluster 2024-09-21T05:00:28.386869+0000 mgr.y (mgr.14385) 31 : cluster [DBG] pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:30 smithi089 bash[19831]: cluster 2024-09-21T05:00:30.387400+0000 mgr.y (mgr.14385) 32 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:30 smithi089 bash[26514]: cluster 2024-09-21T05:00:30.387400+0000 mgr.y (mgr.14385) 32 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:30 smithi110 bash[22020]: cluster 2024-09-21T05:00:30.387400+0000 mgr.y (mgr.14385) 32 : cluster [DBG] pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:31.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.536 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.536 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.536 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.537 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.537 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.537 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.537 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.538 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.538 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.538 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.796 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.796 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.797 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.797 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.797 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.797 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:31.797 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:31 smithi089 systemd[1]: Started Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:00:31.851 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T05:00:32.147 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:31 smithi089 bash[20084]: [21/Sep/2024:05:00:31] ENGINE Bus STOPPING 2024-09-21T05:00:32.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[20084]: [21/Sep/2024:05:00:32] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:00:32.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[20084]: [21/Sep/2024:05:00:32] ENGINE Bus STOPPED 2024-09-21T05:00:32.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[20084]: [21/Sep/2024:05:00:32] ENGINE Bus STARTING 2024-09-21T05:00:32.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[20084]: [21/Sep/2024:05:00:32] ENGINE Serving on http://:::9283 2024-09-21T05:00:32.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[20084]: [21/Sep/2024:05:00:32] ENGINE Bus STARTED 2024-09-21T05:00:32.960 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:32 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:32.960 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.813807+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.960 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.819123+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.960 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.824624+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.829823+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: cephadm 2024-09-21T05:00:31.841415+0000 mgr.y (mgr.14385) 33 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.903907+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.910812+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.914380+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.914878+0000 mgr.y (mgr.14385) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: audit 2024-09-21T05:00:31.919540+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: cephadm 2024-09-21T05:00:31.941052+0000 mgr.y (mgr.14385) 35 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:00:32.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:32 smithi110 bash[22020]: cluster 2024-09-21T05:00:32.388030+0000 mgr.y (mgr.14385) 36 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:33.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.813807+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.819123+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.824624+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.829823+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.085 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: cephadm 2024-09-21T05:00:31.841415+0000 mgr.y (mgr.14385) 33 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.903907+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.910812+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.914380+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.914878+0000 mgr.y (mgr.14385) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: audit 2024-09-21T05:00:31.919540+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: cephadm 2024-09-21T05:00:31.941052+0000 mgr.y (mgr.14385) 35 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[19831]: cluster 2024-09-21T05:00:32.388030+0000 mgr.y (mgr.14385) 36 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.813807+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.819123+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.824624+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.086 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.829823+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: cephadm 2024-09-21T05:00:31.841415+0000 mgr.y (mgr.14385) 33 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.903907+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.910812+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.914380+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.914878+0000 mgr.y (mgr.14385) 34 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: audit 2024-09-21T05:00:31.919540+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: cephadm 2024-09-21T05:00:31.941052+0000 mgr.y (mgr.14385) 35 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:00:33.087 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:32 smithi089 bash[26514]: cluster 2024-09-21T05:00:32.388030+0000 mgr.y (mgr.14385) 36 : cluster [DBG] pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:33.388 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-09-21T05:00:33.388 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDxUu5mL5DKFhAAQtUKFPmfATtqek6/zL0hew== 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.086Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.086Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.088Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.89 port=9094 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.089Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.118Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.119Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.122Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-21T05:00:33.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[50362]: ts=2024-09-21T05:00:33.122Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[19831]: audit 2024-09-21T05:00:33.380800+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.110:0/168913242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[19831]: audit 2024-09-21T05:00:33.382070+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[19831]: audit 2024-09-21T05:00:33.385096+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[26514]: audit 2024-09-21T05:00:33.380800+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.110:0/168913242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[26514]: audit 2024-09-21T05:00:33.382070+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:33 smithi089 bash[26514]: audit 2024-09-21T05:00:33.385096+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:33 smithi110 bash[22020]: audit 2024-09-21T05:00:33.380800+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.110:0/168913242' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:33 smithi110 bash[22020]: audit 2024-09-21T05:00:33.382070+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T05:00:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:33 smithi110 bash[22020]: audit 2024-09-21T05:00:33.385096+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T05:00:34.447 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-21T05:00:34.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T05:00:34.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T05:00:34.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T05:00:35.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:34 smithi089 bash[19831]: cluster 2024-09-21T05:00:34.388613+0000 mgr.y (mgr.14385) 37 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:35.296 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:35 smithi089 bash[50362]: ts=2024-09-21T05:00:35.089Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000332389s 2024-09-21T05:00:35.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:34 smithi089 bash[26514]: cluster 2024-09-21T05:00:34.388613+0000 mgr.y (mgr.14385) 37 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:35.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:34 smithi110 bash[22020]: cluster 2024-09-21T05:00:34.388613+0000 mgr.y (mgr.14385) 37 : cluster [DBG] pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:36.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:36 smithi089 bash[19831]: audit 2024-09-21T05:00:35.471857+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:36 smithi089 bash[26514]: audit 2024-09-21T05:00:35.471857+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:36 smithi110 bash[22020]: audit 2024-09-21T05:00:35.471857+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:37.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:37 smithi089 bash[19831]: cluster 2024-09-21T05:00:36.389218+0000 mgr.y (mgr.14385) 38 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:37.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:37 smithi089 bash[26514]: cluster 2024-09-21T05:00:36.389218+0000 mgr.y (mgr.14385) 38 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:37 smithi110 bash[22020]: cluster 2024-09-21T05:00:36.389218+0000 mgr.y (mgr.14385) 38 : cluster [DBG] pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:39.255 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:00:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:39 smithi110 bash[22020]: cluster 2024-09-21T05:00:38.389857+0000 mgr.y (mgr.14385) 39 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:40.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:39 smithi089 bash[19831]: cluster 2024-09-21T05:00:38.389857+0000 mgr.y (mgr.14385) 39 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:39 smithi089 bash[26514]: cluster 2024-09-21T05:00:38.389857+0000 mgr.y (mgr.14385) 39 : cluster [DBG] pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:40.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:00:40.767 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:40 smithi089 bash[19831]: audit 2024-09-21T05:00:40.459433+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:40.767 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:40 smithi089 bash[26514]: audit 2024-09-21T05:00:40.459433+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:40 smithi110 bash[22020]: audit 2024-09-21T05:00:40.459433+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:41.400 INFO:teuthology.orchestra.run.smithi089.stdout:[{"version":25,"timestamp":"2024-09-21T05:00:31.915906+0000","name":"","changes":[{"name":"mgr/mgr/dashboard/GRAFANA_API_SSL_VERIFY","new_value":"false"}]}] 2024-09-21T05:00:41.401 INFO:tasks.ceph_manager:config epoch is 25 2024-09-21T05:00:41.401 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T05:00:41.401 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T05:00:41.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T05:00:41.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:41 smithi089 bash[19831]: cluster 2024-09-21T05:00:40.390400+0000 mgr.y (mgr.14385) 40 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:41 smithi089 bash[19831]: audit 2024-09-21T05:00:40.756549+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.89:0/511368489' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T05:00:41.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:41 smithi089 bash[26514]: cluster 2024-09-21T05:00:40.390400+0000 mgr.y (mgr.14385) 40 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:41.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:41 smithi089 bash[26514]: audit 2024-09-21T05:00:40.756549+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.89:0/511368489' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T05:00:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:41 smithi110 bash[22020]: cluster 2024-09-21T05:00:40.390400+0000 mgr.y (mgr.14385) 40 : cluster [DBG] pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:41 smithi110 bash[22020]: audit 2024-09-21T05:00:40.756549+0000 mon.c (mon.2) 48 : audit [DBG] from='client.? 172.21.15.89:0/511368489' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T05:00:43.495 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:00:43 smithi089 bash[50362]: ts=2024-09-21T05:00:43.092Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003583803s 2024-09-21T05:00:43.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:43 smithi089 bash[19831]: cluster 2024-09-21T05:00:42.391055+0000 mgr.y (mgr.14385) 41 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:43.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:43 smithi089 bash[26514]: cluster 2024-09-21T05:00:42.391055+0000 mgr.y (mgr.14385) 41 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:43.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:43 smithi110 bash[22020]: cluster 2024-09-21T05:00:42.391055+0000 mgr.y (mgr.14385) 41 : cluster [DBG] pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:45 smithi089 bash[19831]: cluster 2024-09-21T05:00:44.391763+0000 mgr.y (mgr.14385) 42 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:45.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:45 smithi089 bash[26514]: cluster 2024-09-21T05:00:44.391763+0000 mgr.y (mgr.14385) 42 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:45 smithi110 bash[22020]: cluster 2024-09-21T05:00:44.391763+0000 mgr.y (mgr.14385) 42 : cluster [DBG] pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:46.192 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:00:47.621 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:00:47.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:47 smithi089 bash[19831]: cluster 2024-09-21T05:00:46.392516+0000 mgr.y (mgr.14385) 43 : cluster [DBG] pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:47.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:47 smithi089 bash[26514]: cluster 2024-09-21T05:00:46.392516+0000 mgr.y (mgr.14385) 43 : cluster [DBG] pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:47 smithi110 bash[22020]: cluster 2024-09-21T05:00:46.392516+0000 mgr.y (mgr.14385) 43 : cluster [DBG] pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:48.318 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"flags":0,"active_gid":14385,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":765286783},{"type":"v1","addr":"172.21.15.89:6801","nonce":765286783}]},"active_addr":"172.21.15.89:6801/765286783","active_change":"2024-09-21T05:00:10.360210+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24293,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.89:8443/","prometheus":"http://172.21.15.89:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":60,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2668596417}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1021589063}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":4083140151}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3923068703}]}]} 2024-09-21T05:00:48.322 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T05:00:48.323 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T05:00:48.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:00:48.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:48 smithi089 bash[19831]: audit 2024-09-21T05:00:47.614425+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.15.89:0/3580561265' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:00:48.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:48 smithi089 bash[26514]: audit 2024-09-21T05:00:47.614425+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.15.89:0/3580561265' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:00:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:48 smithi110 bash[22020]: audit 2024-09-21T05:00:47.614425+0000 mon.a (mon.0) 711 : audit [DBG] from='client.? 172.21.15.89:0/3580561265' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:00:49.195 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.196 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.196 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.196 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.197 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.197 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.197 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.197 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.519 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.520 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.520 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.520 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.520 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: Started Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:00:49.521 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.522 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.522 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:00:49 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:00:49.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[19831]: cluster 2024-09-21T05:00:48.393018+0000 mgr.y (mgr.14385) 44 : cluster [DBG] pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:49.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[19831]: audit 2024-09-21T05:00:49.494473+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:49.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[19831]: audit 2024-09-21T05:00:49.506568+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[26514]: cluster 2024-09-21T05:00:48.393018+0000 mgr.y (mgr.14385) 44 : cluster [DBG] pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[26514]: audit 2024-09-21T05:00:49.494473+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:49 smithi089 bash[26514]: audit 2024-09-21T05:00:49.506568+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:49 smithi110 bash[22020]: cluster 2024-09-21T05:00:48.393018+0000 mgr.y (mgr.14385) 44 : cluster [DBG] pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:49 smithi110 bash[22020]: audit 2024-09-21T05:00:49.494473+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:49 smithi110 bash[22020]: audit 2024-09-21T05:00:49.506568+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:49.538008+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:49.548828+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:49.588665+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:50.145591+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:50.150984+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.707 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[22020]: audit 2024-09-21T05:00:50.484020+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.70507371Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705270767Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705285205Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705289028Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705293001Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705296095Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705299005Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705301951Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705305713Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705311023Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705316252Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-21T05:00:50.708 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705321067Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705333535Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705340935Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.70534629Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705350554Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705353542Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705358163Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=settings t=2024-09-21T05:00:50.705362371Z level=info msg="App mode production" 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=sqlstore t=2024-09-21T05:00:50.705420602Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=sqlstore t=2024-09-21T05:00:50.705435321Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.706433256Z level=info msg="Starting DB migrations" 2024-09-21T05:00:50.709 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.706507823Z level=info msg="Executing migration" id="create migration_log table" 2024-09-21T05:00:50.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:49.538008+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:49.548828+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:49.588665+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:50.145591+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:50.150984+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[19831]: audit 2024-09-21T05:00:50.484020+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:49.538008+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:49.548828+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:49.588665+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:50.145591+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:50.150984+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:50 smithi089 bash[26514]: audit 2024-09-21T05:00:50.484020+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.754103998Z level=info msg="Executing migration" id="create user table" 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.77925133Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.821429074Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.863501039Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.889018388Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-21T05:00:50.964 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.914252264Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-21T05:00:50.965 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.939668023Z level=info msg="Executing migration" id="create user table v2" 2024-09-21T05:00:50.965 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.964860493Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-21T05:00:51.241 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:50 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:50.990201997Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.015461445Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.040602055Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.065985285Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.091210737Z level=info msg="Executing migration" id="Update user table charset" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.133285917Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.175215762Z level=info msg="Executing migration" id="Add missing user data" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.200527174Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-21T05:00:51.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.242516076Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.267799647Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.309726989Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.326784203Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.368777471Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.419298715Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.444550854Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.486501936Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-21T05:00:51.511 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.511788385Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[22020]: cluster 2024-09-21T05:00:50.393550+0000 mgr.y (mgr.14385) 45 : cluster [DBG] pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.537086882Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.57909667Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.621119628Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.646327197Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.671712867Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-21T05:00:51.772 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.696974052Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-21T05:00:51.773 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.722179765Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-21T05:00:51.773 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.747764428Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-21T05:00:51.773 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.772995944Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-21T05:00:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:51 smithi089 bash[19831]: cluster 2024-09-21T05:00:50.393550+0000 mgr.y (mgr.14385) 45 : cluster [DBG] pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:51 smithi089 bash[26514]: cluster 2024-09-21T05:00:50.393550+0000 mgr.y (mgr.14385) 45 : cluster [DBG] pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.798248259Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.823634265Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.848759903Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.874000798Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.89923161Z level=info msg="Executing migration" id="create star table" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.924521235Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.949884459Z level=info msg="Executing migration" id="create org table v1" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:51 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:51.975145937Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.000263637Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-21T05:00:52.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.025649288Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.067622075Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.10967125Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.151725874Z level=info msg="Executing migration" id="Update org table charset" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.176893192Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.202133468Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.244095085Z level=info msg="Executing migration" id="create dashboard table" 2024-09-21T05:00:52.294 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.269444862Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-21T05:00:52.295 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.294682269Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-21T05:00:52.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.336707551Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-21T05:00:52.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.362008659Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.404019689Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.420930285Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.44623646Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.479835629Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.513593971Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-21T05:00:52.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.538834066Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.581188081Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.606495953Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.631822161Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.656821171Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.682133621Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.707365919Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.732551999Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.808075496Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-21T05:00:52.833 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.833388662Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-21T05:00:53.093 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.8752699Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-21T05:00:53.093 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.900621718Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-21T05:00:53.093 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.925907753Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-21T05:00:53.093 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.959645996Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-21T05:00:53.094 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:52 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:52.9847937Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-21T05:00:53.094 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.010031241Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-21T05:00:53.094 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.035279258Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-21T05:00:53.094 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.093933807Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-21T05:00:53.118 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:00:53.346 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.135970407Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-21T05:00:53.346 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.161187817Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-21T05:00:53.346 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.186479363Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-21T05:00:53.347 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.228434915Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-21T05:00:53.347 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.253776923Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-21T05:00:53.347 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.279002047Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-21T05:00:53.347 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.304203205Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-21T05:00:53.347 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.346286167Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-21T05:00:53.606 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[22020]: cluster 2024-09-21T05:00:52.394177+0000 mgr.y (mgr.14385) 46 : cluster [DBG] pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.388212838Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.413457319Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.438839206Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.480732395Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.52305098Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.565210721Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-21T05:00:53.607 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.607267641Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-21T05:00:53.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:53 smithi089 bash[19831]: cluster 2024-09-21T05:00:52.394177+0000 mgr.y (mgr.14385) 46 : cluster [DBG] pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:53.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:53 smithi089 bash[26514]: cluster 2024-09-21T05:00:52.394177+0000 mgr.y (mgr.14385) 46 : cluster [DBG] pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.632615963Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.657916229Z level=info msg="Executing migration" id="create data_source table" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.683119Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.708250885Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.733643103Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.758845577Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-21T05:00:53.859 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.784149743Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-21T05:00:53.860 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.809450252Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-21T05:00:53.860 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.834673396Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-21T05:00:53.860 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.859940052Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.885174764Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.91042981Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.935734236Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.960946947Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:53 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:53.986148328Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.011427928Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.053503781Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.095501193Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-21T05:00:54.120 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.120780407Z level=info msg="Executing migration" id="Add uid column" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.162677943Z level=info msg="Executing migration" id="Update uid value" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.187863746Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.229854127Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.255218804Z level=info msg="Executing migration" id="create api_key table" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.297321656Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.339632674Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-21T05:00:54.381 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.38162757Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-21T05:00:54.591 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:00:54.591 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":60,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","created":"2024-09-21T04:49:45.405755+0000","modified":"2024-09-21T05:00:10.359965+0000","last_up_change":"2024-09-21T04:59:21.743498+0000","last_in_change":"2024-09-21T04:58:51.918815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T04:54:53.066224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cedd9ea3-6157-4152-a26d-369dff19cffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6803","nonce":334393973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6805","nonce":334393973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6809","nonce":334393973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6807","nonce":334393973}]},"public_addr":"172.21.15.89:6803/334393973","cluster_addr":"172.21.15.89:6805/334393973","heartbeat_back_addr":"172.21.15.89:6809/334393973","heartbeat_front_addr":"172.21.15.89:6807/334393973","state":["exists","up"]},{"osd":1,"uuid":"8f0b6d96-66a0-4fe1-a8a3-340baef4cf82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6811","nonce":542485341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6813","nonce":542485341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6817","nonce":542485341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6815","nonce":542485341}]},"public_addr":"172.21.15.89:6811/542485341","cluster_addr":"172.21.15.89:6813/542485341","heartbeat_back_addr":"172.21.15.89:6817/542485341","heartbeat_front_addr":"172.21.15.89:6815/542485341","state":["exists","up"]},{"osd":2,"uuid":"14556fdf-44d6-48ab-a2ef-8449f4a60ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6819","nonce":646968819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6821","nonce":646968819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6825","nonce":646968819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6823","nonce":646968819}]},"public_addr":"172.21.15.89:6819/646968819","cluster_addr":"172.21.15.89:6821/646968819","heartbeat_back_addr":"172.21.15.89:6825/646968819","heartbeat_front_addr":"172.21.15.89:6823/646968819","state":["exists","up"]},{"osd":3,"uuid":"588e6cd4-48b9-4090-a3bf-1c8e6be3e77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6827","nonce":1874825091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6829","nonce":1874825091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6833","nonce":1874825091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6831","nonce":1874825091}]},"public_addr":"172.21.15.89:6827/1874825091","cluster_addr":"172.21.15.89:6829/1874825091","heartbeat_back_addr":"172.21.15.89:6833/1874825091","heartbeat_front_addr":"172.21.15.89:6831/1874825091","state":["exists","up"]},{"osd":4,"uuid":"4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6801","nonce":2769401539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6803","nonce":2769401539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6807","nonce":2769401539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6805","nonce":2769401539}]},"public_addr":"172.21.15.110:6801/2769401539","cluster_addr":"172.21.15.110:6803/2769401539","heartbeat_back_addr":"172.21.15.110:6807/2769401539","heartbeat_front_addr":"172.21.15.110:6805/2769401539","state":["exists","up"]},{"osd":5,"uuid":"860b7538-f4da-4353-b0be-8d8d582f6225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6809","nonce":1758841566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6811","nonce":1758841566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6815","nonce":1758841566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6813","nonce":1758841566}]},"public_addr":"172.21.15.110:6809/1758841566","cluster_addr":"172.21.15.110:6811/1758841566","heartbeat_back_addr":"172.21.15.110:6815/1758841566","heartbeat_front_addr":"172.21.15.110:6813/1758841566","state":["exists","up"]},{"osd":6,"uuid":"dd2cbf05-398e-4f6c-a58f-ac9f7402f06f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6817","nonce":3802633513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6819","nonce":3802633513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6823","nonce":3802633513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6821","nonce":3802633513}]},"public_addr":"172.21.15.110:6817/3802633513","cluster_addr":"172.21.15.110:6819/3802633513","heartbeat_back_addr":"172.21.15.110:6823/3802633513","heartbeat_front_addr":"172.21.15.110:6821/3802633513","state":["exists","up"]},{"osd":7,"uuid":"ee200566-ff5d-4490-9bd2-0f76dae3856c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6825","nonce":2363981867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6827","nonce":2363981867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6831","nonce":2363981867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6829","nonce":2363981867}]},"public_addr":"172.21.15.110:6825/2363981867","cluster_addr":"172.21.15.110:6827/2363981867","heartbeat_back_addr":"172.21.15.110:6831/2363981867","heartbeat_front_addr":"172.21.15.110:6829/2363981867","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:00.639074+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:54.066831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:54:49.301362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:55:45.452301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:56:36.707000+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:57:30.504647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:58:24.097519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:59:20.488430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2004572141":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/1370258133":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/3989638145":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1270436840":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/4040295346":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6801/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6801/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1007953151":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1787884428":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/2018380474":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/1588549793":"2024-09-22T05:00:10.359887+0000","172.21.15.89:6801/2247079945":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/563715280":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/2247079945":"2024-09-22T05:00:10.359887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.423713434Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.465699942Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.482747039Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.499705253Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.516594448Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.533533609Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.567143172Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-21T05:00:54.659 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.592472715Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-21T05:00:54.660 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.617794075Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-21T05:00:54.660 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.659744207Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.684756706Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.726861074Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.768879448Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.810986405Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.827888326Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-21T05:00:54.911 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.844807819Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-21T05:00:54.912 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.861775604Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-21T05:00:54.912 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.895409323Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-21T05:00:54.912 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.912409037Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-21T05:00:55.164 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.937644937Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-21T05:00:55.164 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.962962786Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-21T05:00:55.164 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:54 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:54.97984495Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-21T05:00:55.164 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.021918224Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-21T05:00:55.165 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.064040758Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-21T05:00:55.165 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.098136802Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-21T05:00:55.165 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.14005363Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-21T05:00:55.165 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.16545055Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-21T05:00:55.202 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T05:00:55.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T05:00:55.450 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.207513364Z level=info msg="Executing migration" id="create quota table v1" 2024-09-21T05:00:55.450 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.249681609Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-21T05:00:55.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.27497028Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-21T05:00:55.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.31695983Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-21T05:00:55.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.384070517Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-21T05:00:55.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.409519066Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-21T05:00:55.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.451463243Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-21T05:00:55.703 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[22020]: cluster 2024-09-21T05:00:54.394549+0000 mgr.y (mgr.14385) 47 : cluster [DBG] pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:55.703 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[22020]: audit 2024-09-21T05:00:54.591316+0000 mon.c (mon.2) 50 : audit [DBG] from='client.? 172.21.15.89:0/379998853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:00:55.704 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[22020]: audit 2024-09-21T05:00:55.434509+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:55.704 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[22020]: audit 2024-09-21T05:00:55.443877+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:55.704 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[22020]: audit 2024-09-21T05:00:55.460150+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.493360189Z level=info msg="Executing migration" id="create session table" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.519082338Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.544091613Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.586301572Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.611508921Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.653615005Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.678779598Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-21T05:00:55.704 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.704042967Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-21T05:00:55.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.729324171Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-21T05:00:55.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.754590735Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-21T05:00:55.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.779934392Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-21T05:00:55.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.805111212Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-21T05:00:55.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.830361373Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-21T05:00:55.957 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.855626794Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-21T05:00:55.957 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.880856413Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-21T05:00:55.957 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.906121571Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-21T05:00:55.957 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.931572649Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-21T05:00:55.957 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.956974092Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-21T05:00:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[26514]: cluster 2024-09-21T05:00:54.394549+0000 mgr.y (mgr.14385) 47 : cluster [DBG] pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[26514]: audit 2024-09-21T05:00:54.591316+0000 mon.c (mon.2) 50 : audit [DBG] from='client.? 172.21.15.89:0/379998853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:00:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[26514]: audit 2024-09-21T05:00:55.434509+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[26514]: audit 2024-09-21T05:00:55.443877+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[26514]: audit 2024-09-21T05:00:55.460150+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[19831]: cluster 2024-09-21T05:00:54.394549+0000 mgr.y (mgr.14385) 47 : cluster [DBG] pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[19831]: audit 2024-09-21T05:00:54.591316+0000 mon.c (mon.2) 50 : audit [DBG] from='client.? 172.21.15.89:0/379998853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[19831]: audit 2024-09-21T05:00:55.434509+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[19831]: audit 2024-09-21T05:00:55.443877+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:55 smithi089 bash[19831]: audit 2024-09-21T05:00:55.460150+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:55 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:55.982292985Z level=info msg="Executing migration" id="create alert table v1" 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.024131108Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.066245343Z level=info msg="Executing migration" id="add index alert state" 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.09144401Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.116703905Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.158754149Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-21T05:00:56.242 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.20074013Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.242709477Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.27626028Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.318315523Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.34369359Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.385542676Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-21T05:00:56.494 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.427731591Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-21T05:00:56.495 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.46963614Z level=info msg="Executing migration" id="Add column is_default" 2024-09-21T05:00:56.495 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.494941075Z level=info msg="Executing migration" id="Add column frequency" 2024-09-21T05:00:56.763 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.52018283Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-21T05:00:56.763 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.545464302Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.570707118Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.612717622Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.637970687Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.663246639Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.688582377Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.713799199Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.739073274Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-21T05:00:56.764 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.764263677Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-21T05:00:57.024 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.789566779Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.814818088Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.848656923Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.923939591Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.940928568Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.957827627Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.974731968Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:56 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:56.991684489Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-21T05:00:57.025 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.025341991Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: audit 2024-09-21T05:00:56.179417+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: audit 2024-09-21T05:00:56.184974+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: audit 2024-09-21T05:00:56.186297+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: audit 2024-09-21T05:00:56.187053+0000 mon.c (mon.2) 53 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: audit 2024-09-21T05:00:56.191941+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.277 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: cephadm 2024-09-21T05:00:56.223825+0000 mgr.y (mgr.14385) 48 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T05:00:57.278 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: cephadm 2024-09-21T05:00:56.226931+0000 mgr.y (mgr.14385) 49 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi089 2024-09-21T05:00:57.278 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[22020]: cluster 2024-09-21T05:00:56.395065+0000 mgr.y (mgr.14385) 50 : cluster [DBG] pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.050714895Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.075954314Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.101194655Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.126497846Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.151717937Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.193648506Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.235823825Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-21T05:00:57.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.27787737Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: audit 2024-09-21T05:00:56.179417+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: audit 2024-09-21T05:00:56.184974+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: audit 2024-09-21T05:00:56.186297+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: audit 2024-09-21T05:00:56.187053+0000 mon.c (mon.2) 53 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: audit 2024-09-21T05:00:56.191941+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: cephadm 2024-09-21T05:00:56.223825+0000 mgr.y (mgr.14385) 48 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T05:00:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: cephadm 2024-09-21T05:00:56.226931+0000 mgr.y (mgr.14385) 49 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi089 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[19831]: cluster 2024-09-21T05:00:56.395065+0000 mgr.y (mgr.14385) 50 : cluster [DBG] pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: audit 2024-09-21T05:00:56.179417+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: audit 2024-09-21T05:00:56.184974+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: audit 2024-09-21T05:00:56.186297+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: audit 2024-09-21T05:00:56.187053+0000 mon.c (mon.2) 53 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: audit 2024-09-21T05:00:56.191941+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: cephadm 2024-09-21T05:00:56.223825+0000 mgr.y (mgr.14385) 48 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: cephadm 2024-09-21T05:00:56.226931+0000 mgr.y (mgr.14385) 49 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi089 2024-09-21T05:00:57.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:57 smithi089 bash[26514]: cluster 2024-09-21T05:00:56.395065+0000 mgr.y (mgr.14385) 50 : cluster [DBG] pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:57.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.319860542Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-21T05:00:57.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.345168587Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-21T05:00:57.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.370427916Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-21T05:00:57.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.395736476Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-21T05:00:57.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.437736258Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-21T05:00:57.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.479704474Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-21T05:00:57.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.505106731Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-21T05:00:57.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.555285721Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.597310756Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.622634555Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.647835312Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.673171067Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.698693486Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.72386664Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.749168666Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.774430859Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.799799653Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-21T05:00:57.841 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.841651761Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-21T05:00:58.101 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.866916326Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.892180003Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.917473722Z level=info msg="Executing migration" id="Move region to single row" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.942653906Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.968013227Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:57 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:57.993294452Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.018529216Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.060494743Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-21T05:00:58.102 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.10245277Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.127809835Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.153072645Z level=info msg="Executing migration" id="create test_data table" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.195049929Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.237130518Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.279110758Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.304373685Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.346294715Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-21T05:00:58.371 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.371633508Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-21T05:00:58.623 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.413555792Z level=info msg="Executing migration" id="create team table" 2024-09-21T05:00:58.623 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.438941084Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-21T05:00:58.623 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.480930973Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-21T05:00:58.624 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.506139921Z level=info msg="Executing migration" id="create team member table" 2024-09-21T05:00:58.624 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.531374432Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-21T05:00:58.624 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.57330589Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-21T05:00:58.624 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.598840975Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-21T05:00:58.624 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.624120952Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-21T05:00:58.909 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.666114435Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-21T05:00:58.909 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.691442164Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.716671065Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.741954248Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.767200438Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.792433255Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.817722076Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.843054638Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.86821115Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-21T05:00:58.910 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.910281978Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-21T05:00:59.161 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.952155927Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:58 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:58.977648013Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.002862611Z level=info msg="Executing migration" id="create tag table" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.028080656Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.053411782Z level=info msg="Executing migration" id="create login attempt table" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.095282078Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.137269053Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-21T05:00:59.162 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.16253942Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-21T05:00:59.422 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.196100359Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-21T05:00:59.422 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.238096573Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.280065238Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.305311251Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.347381298Z level=info msg="Executing migration" id="create user auth table" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.37262946Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.406343453Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-21T05:00:59.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.423331416Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-21T05:00:59.675 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[22020]: cluster 2024-09-21T05:00:58.395671+0000 mgr.y (mgr.14385) 51 : cluster [DBG] pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:59.675 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.465648845Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-21T05:00:59.675 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.507761367Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-21T05:00:59.675 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.549748938Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-21T05:00:59.675 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.575090391Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-21T05:00:59.675 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.600172515Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-21T05:00:59.676 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.625497218Z level=info msg="Executing migration" id="create server_lock table" 2024-09-21T05:00:59.676 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.650783122Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-21T05:00:59.676 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.676094646Z level=info msg="Executing migration" id="create user auth token table" 2024-09-21T05:00:59.725 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:00:59 smithi089 bash[19831]: cluster 2024-09-21T05:00:58.395671+0000 mgr.y (mgr.14385) 51 : cluster [DBG] pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:59.725 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:00:59 smithi089 bash[26514]: cluster 2024-09-21T05:00:58.395671+0000 mgr.y (mgr.14385) 51 : cluster [DBG] pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:00:59.742 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.70135749Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.726569692Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.751925021Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.77709437Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.802311085Z level=info msg="Executing migration" id="create cache_data table" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.827653498Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.852813501Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.8781865Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.920099562Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-21T05:00:59.945 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:00:59 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:00:59.945389056Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.004052054Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.029400755Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.071285575Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.11331062Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.138486222Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-21T05:01:00.205 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.163901362Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-21T05:01:00.370 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:00 smithi089 systemd[1]: Stopping Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:01:00.474 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.206015486Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-21T05:01:00.474 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.222854708Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.264821971Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.306821763Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.357383282Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.382703036Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.424685348Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-21T05:01:00.475 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.475140249Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.517120261Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.54235441Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.567719331Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.592905656Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.618143642Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.64341941Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.668616803Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-21T05:01:00.785 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.693800138Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-21T05:01:00.786 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.785890733Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-21T05:01:01.045 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:00 smithi089 bash[50362]: ts=2024-09-21T05:01:00.752Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:01:01.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:00 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:00.904676645Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-21T05:01:01.338 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.069973904Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-21T05:01:01.338 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.111961441Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-21T05:01:01.338 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.137201174Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-21T05:01:01.338 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.162500342Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-21T05:01:01.338 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.187778967Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-21T05:01:01.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.229756578Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-21T05:01:01.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.255038753Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-21T05:01:01.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.29700276Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-21T05:01:01.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.338928237Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[22020]: cluster 2024-09-21T05:01:00.396054+0000 mgr.y (mgr.14385) 52 : cluster [DBG] pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.364139347Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.406296322Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.44817927Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.490514171Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.534591476Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-21T05:01:01.601 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.55996943Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-21T05:01:01.664 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:01 smithi089 bash[19831]: cluster 2024-09-21T05:01:00.396054+0000 mgr.y (mgr.14385) 52 : cluster [DBG] pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:01.664 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:01 smithi089 bash[26514]: cluster 2024-09-21T05:01:00.396054+0000 mgr.y (mgr.14385) 52 : cluster [DBG] pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:01.664 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:01 smithi089 bash[51376]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:01:01.664 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:01 smithi089 bash[51437]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:01:01.664 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:01 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T05:01:01.664 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:01 smithi089 systemd[1]: Stopped Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:01:01.665 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:01 smithi089 systemd[1]: Started Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.60191232Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.6271812Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.652331036Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.677628092Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.71972533Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.744971679Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.770189852Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.812053131Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.837358396Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-21T05:01:01.862 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.862644858Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-21T05:01:01.975 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:01:01.975 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":60,"fsid":"bfdfee20-77d4-11ef-baf5-efdc52797490","created":"2024-09-21T04:49:45.405755+0000","modified":"2024-09-21T05:00:10.359965+0000","last_up_change":"2024-09-21T04:59:21.743498+0000","last_in_change":"2024-09-21T04:58:51.918815+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T04:54:53.066224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cedd9ea3-6157-4152-a26d-369dff19cffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6803","nonce":334393973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6805","nonce":334393973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6809","nonce":334393973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":334393973},{"type":"v1","addr":"172.21.15.89:6807","nonce":334393973}]},"public_addr":"172.21.15.89:6803/334393973","cluster_addr":"172.21.15.89:6805/334393973","heartbeat_back_addr":"172.21.15.89:6809/334393973","heartbeat_front_addr":"172.21.15.89:6807/334393973","state":["exists","up"]},{"osd":1,"uuid":"8f0b6d96-66a0-4fe1-a8a3-340baef4cf82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6811","nonce":542485341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6813","nonce":542485341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6817","nonce":542485341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":542485341},{"type":"v1","addr":"172.21.15.89:6815","nonce":542485341}]},"public_addr":"172.21.15.89:6811/542485341","cluster_addr":"172.21.15.89:6813/542485341","heartbeat_back_addr":"172.21.15.89:6817/542485341","heartbeat_front_addr":"172.21.15.89:6815/542485341","state":["exists","up"]},{"osd":2,"uuid":"14556fdf-44d6-48ab-a2ef-8449f4a60ce9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6819","nonce":646968819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6821","nonce":646968819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6825","nonce":646968819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":646968819},{"type":"v1","addr":"172.21.15.89:6823","nonce":646968819}]},"public_addr":"172.21.15.89:6819/646968819","cluster_addr":"172.21.15.89:6821/646968819","heartbeat_back_addr":"172.21.15.89:6825/646968819","heartbeat_front_addr":"172.21.15.89:6823/646968819","state":["exists","up"]},{"osd":3,"uuid":"588e6cd4-48b9-4090-a3bf-1c8e6be3e77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6827","nonce":1874825091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6829","nonce":1874825091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6833","nonce":1874825091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":1874825091},{"type":"v1","addr":"172.21.15.89:6831","nonce":1874825091}]},"public_addr":"172.21.15.89:6827/1874825091","cluster_addr":"172.21.15.89:6829/1874825091","heartbeat_back_addr":"172.21.15.89:6833/1874825091","heartbeat_front_addr":"172.21.15.89:6831/1874825091","state":["exists","up"]},{"osd":4,"uuid":"4c2bf8d7-64fe-4b46-9fb4-31fb0c00c4b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6801","nonce":2769401539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6803","nonce":2769401539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6807","nonce":2769401539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2769401539},{"type":"v1","addr":"172.21.15.110:6805","nonce":2769401539}]},"public_addr":"172.21.15.110:6801/2769401539","cluster_addr":"172.21.15.110:6803/2769401539","heartbeat_back_addr":"172.21.15.110:6807/2769401539","heartbeat_front_addr":"172.21.15.110:6805/2769401539","state":["exists","up"]},{"osd":5,"uuid":"860b7538-f4da-4353-b0be-8d8d582f6225","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6809","nonce":1758841566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6811","nonce":1758841566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6815","nonce":1758841566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1758841566},{"type":"v1","addr":"172.21.15.110:6813","nonce":1758841566}]},"public_addr":"172.21.15.110:6809/1758841566","cluster_addr":"172.21.15.110:6811/1758841566","heartbeat_back_addr":"172.21.15.110:6815/1758841566","heartbeat_front_addr":"172.21.15.110:6813/1758841566","state":["exists","up"]},{"osd":6,"uuid":"dd2cbf05-398e-4f6c-a58f-ac9f7402f06f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6817","nonce":3802633513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6819","nonce":3802633513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6823","nonce":3802633513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3802633513},{"type":"v1","addr":"172.21.15.110:6821","nonce":3802633513}]},"public_addr":"172.21.15.110:6817/3802633513","cluster_addr":"172.21.15.110:6819/3802633513","heartbeat_back_addr":"172.21.15.110:6823/3802633513","heartbeat_front_addr":"172.21.15.110:6821/3802633513","state":["exists","up"]},{"osd":7,"uuid":"ee200566-ff5d-4490-9bd2-0f76dae3856c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6825","nonce":2363981867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6827","nonce":2363981867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6831","nonce":2363981867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2363981867},{"type":"v1","addr":"172.21.15.110:6829","nonce":2363981867}]},"public_addr":"172.21.15.110:6825/2363981867","cluster_addr":"172.21.15.110:6827/2363981867","heartbeat_back_addr":"172.21.15.110:6831/2363981867","heartbeat_front_addr":"172.21.15.110:6829/2363981867","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:00.639074+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:53:54.066831+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:54:49.301362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:55:45.452301+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:56:36.707000+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:57:30.504647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:58:24.097519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T04:59:20.488430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:0/2004572141":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/1370258133":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/3989638145":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1270436840":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/4040295346":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6801/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:6801/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/1926185681":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1007953151":"2024-09-22T04:50:12.667821+0000","172.21.15.89:0/1787884428":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/2018380474":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/1309687529":"2024-09-22T04:50:44.483793+0000","172.21.15.89:0/1588549793":"2024-09-22T05:00:10.359887+0000","172.21.15.89:6801/2247079945":"2024-09-22T05:00:10.359887+0000","172.21.15.89:0/563715280":"2024-09-22T04:50:44.483793+0000","172.21.15.89:6800/2247079945":"2024-09-22T05:00:10.359887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.887866408Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.913010195Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.938309414Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.963468488Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:01 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:01.988770616Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.014061111Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.056051792Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-21T05:01:02.131 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.081275619Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-21T05:01:02.132 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.106540139Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-21T05:01:02.132 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.131754496Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.15693056Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.182194219Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.224118258Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.249399041Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.291385559Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.33343718Z level=info msg="Executing migration" id="create alert_image table" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.358697472Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-21T05:01:02.383 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.383908923Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-21T05:01:02.696 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.42577204Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-21T05:01:02.696 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.480093242Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-21T05:01:02.696 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.535659058Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T05:01:02.696 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.536015867Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-21T05:01:02.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: audit 2024-09-21T05:01:01.696336+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:02.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: audit 2024-09-21T05:01:01.702289+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:02.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: cephadm 2024-09-21T05:01:01.704621+0000 mgr.y (mgr.14385) 53 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:01:02.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: cephadm 2024-09-21T05:01:01.945413+0000 mgr.y (mgr.14385) 54 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: audit 2024-09-21T05:01:01.975253+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.89:0/1382914169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[26514]: cluster 2024-09-21T05:01:02.396626+0000 mgr.y (mgr.14385) 55 : cluster [DBG] pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: audit 2024-09-21T05:01:01.696336+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: audit 2024-09-21T05:01:01.702289+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: cephadm 2024-09-21T05:01:01.704621+0000 mgr.y (mgr.14385) 53 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: cephadm 2024-09-21T05:01:01.945413+0000 mgr.y (mgr.14385) 54 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: audit 2024-09-21T05:01:01.975253+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.89:0/1382914169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:01:02.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:02 smithi089 bash[19831]: cluster 2024-09-21T05:01:02.396626+0000 mgr.y (mgr.14385) 55 : cluster [DBG] pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:02.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T05:01:02.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T05:01:02.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T05:01:02.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T05:01:02.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T05:01:02.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T05:01:02.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T05:01:02.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T05:01:03.008 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:02.717056603Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-21T05:01:03.008 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: audit 2024-09-21T05:01:01.696336+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:03.009 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: audit 2024-09-21T05:01:01.702289+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:03.009 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: cephadm 2024-09-21T05:01:01.704621+0000 mgr.y (mgr.14385) 53 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:01:03.009 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: cephadm 2024-09-21T05:01:01.945413+0000 mgr.y (mgr.14385) 54 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:01:03.009 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: audit 2024-09-21T05:01:01.975253+0000 mon.c (mon.2) 54 : audit [DBG] from='client.? 172.21.15.89:0/1382914169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T05:01:03.009 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:02 smithi110 bash[22020]: cluster 2024-09-21T05:01:02.396626+0000 mgr.y (mgr.14385) 55 : cluster [DBG] pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:03.269 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.009402609Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-21T05:01:03.270 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.139097629Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-21T05:01:03.270 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.139562569Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-21T05:01:03.270 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.139987895Z level=info msg="alerts found to migrate" alerts=0 2024-09-21T05:01:03.270 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.206017203Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.312Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.312Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.314Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.89 port=9094 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.315Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.344Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.344Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.351Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-21T05:01:03.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:03 smithi089 bash[51498]: ts=2024-09-21T05:01:03.351Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T05:01:03.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.270068933Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-21T05:01:03.808 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.557532675Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-21T05:01:03.808 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.666343884Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-21T05:01:03.808 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.742150125Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-21T05:01:04.079 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.809177846Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-21T05:01:04.079 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.901127236Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-21T05:01:04.079 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:03 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:03.952109118Z level=info msg="Executing migration" id="create data_keys table" 2024-09-21T05:01:04.079 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.020099739Z level=info msg="Executing migration" id="create secrets table" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.080241627Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.13647719Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.187239193Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.254518989Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.321813933Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-21T05:01:04.405 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.40566864Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-21T05:01:04.664 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.492759896Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-21T05:01:04.973 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.665134892Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-21T05:01:04.974 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.898837879Z level=info msg="Executing migration" id="create permission table" 2024-09-21T05:01:05.268 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:04 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:04.974531361Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-21T05:01:05.268 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.050313485Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-21T05:01:05.269 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.160079275Z level=info msg="Executing migration" id="create role table" 2024-09-21T05:01:05.269 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.210555353Z level=info msg="Executing migration" id="add column display_name" 2024-09-21T05:01:05.269 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.2694325Z level=info msg="Executing migration" id="add column group_name" 2024-09-21T05:01:05.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[22020]: cluster 2024-09-21T05:01:04.397191+0000 mgr.y (mgr.14385) 56 : cluster [DBG] pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:05.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.480006278Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-21T05:01:05.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:05 smithi089 bash[19831]: cluster 2024-09-21T05:01:04.397191+0000 mgr.y (mgr.14385) 56 : cluster [DBG] pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:05.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:05 smithi089 bash[26514]: cluster 2024-09-21T05:01:04.397191+0000 mgr.y (mgr.14385) 56 : cluster [DBG] pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:05.796 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:05 smithi089 bash[51498]: ts=2024-09-21T05:01:05.315Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000181128s 2024-09-21T05:01:06.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.609565944Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-21T05:01:06.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.722523794Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-21T05:01:06.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:05 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:05.806772576Z level=info msg="Executing migration" id="create team role table" 2024-09-21T05:01:06.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.082826381Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-21T05:01:06.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.183388196Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-21T05:01:06.339 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.259180428Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-21T05:01:06.612 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.34009346Z level=info msg="Executing migration" id="create user role table" 2024-09-21T05:01:06.612 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.425813242Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-21T05:01:06.612 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.485806191Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-21T05:01:06.612 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.544537371Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-21T05:01:06.612 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.613148838Z level=info msg="Executing migration" id="create builtin role table" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.653596991Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.670493916Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.687706675Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.738049827Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.797005204Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.863001075Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-21T05:01:06.956 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:06 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:06.956665592Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-21T05:01:07.223 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.059039372Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-21T05:01:07.549 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[22020]: cluster 2024-09-21T05:01:06.397782+0000 mgr.y (mgr.14385) 57 : cluster [DBG] pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:07.550 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.224154774Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-21T05:01:07.550 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.460714787Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-21T05:01:07.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:07 smithi089 bash[19831]: cluster 2024-09-21T05:01:06.397782+0000 mgr.y (mgr.14385) 57 : cluster [DBG] pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:07.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:07 smithi089 bash[26514]: cluster 2024-09-21T05:01:06.397782+0000 mgr.y (mgr.14385) 57 : cluster [DBG] pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:07.804 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:01:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.550555772Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-21T05:01:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.626283678Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-21T05:01:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.719284155Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-21T05:01:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.761082889Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-21T05:01:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.786402263Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-21T05:01:07.879 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.880 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.880 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.880 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.881 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.882 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.882 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:07.883 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:08.089 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.836851699Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-21T05:01:08.089 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.895914247Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-21T05:01:08.089 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:07.938041744Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-21T05:01:08.089 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.004356235Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-21T05:01:08.089 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.089932065Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.885Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:01:08.090 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:07 smithi110 bash[45748]: ts=2024-09-21T05:01:07.886Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:01:08.364 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.175702448Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-21T05:01:08.692 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.365105048Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-21T05:01:08.968 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47645]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:01:08.969 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47704]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:01:08.969 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:08 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:01:08.969 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:08 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:01:08.969 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:08 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:01:08.969 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.673894262Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-21T05:01:08.969 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.766417747Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-21T05:01:08.969 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.833815284Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-21T05:01:08.969 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.893421175Z level=info msg="Executing migration" id="add correlation config column" 2024-09-21T05:01:08.969 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.918732038Z level=info msg="Executing migration" id="create entity_events table" 2024-09-21T05:01:09.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:08 smithi089 bash[20084]: [21/Sep/2024:05:01:08] ENGINE Bus STOPPING 2024-09-21T05:01:09.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:08 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:08.969833778Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-21T05:01:09.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.036872102Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T05:01:09.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.037054586Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-21T05:01:09.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.203885789Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T05:01:09.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.204137028Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STOPPED 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STARTING 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Serving on http://:::9283 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STARTED 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STOPPING 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: cluster 2024-09-21T05:01:08.398312+0000 mgr.y (mgr.14385) 58 : cluster [DBG] pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.935610+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.947967+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.954343+0000 mon.c (mon.2) 55 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.956648+0000 mon.c (mon.2) 56 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.962586+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.983915+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.989736+0000 mon.c (mon.2) 58 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:08.995508+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:09.009767+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:09.015419+0000 mon.c (mon.2) 60 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:09.022903+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[19831]: audit 2024-09-21T05:01:09.102879+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: cluster 2024-09-21T05:01:08.398312+0000 mgr.y (mgr.14385) 58 : cluster [DBG] pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.935610+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.947967+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.954343+0000 mon.c (mon.2) 55 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.956648+0000 mon.c (mon.2) 56 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.962586+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.983915+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.989736+0000 mon.c (mon.2) 58 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:08.995508+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:09.009767+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:09.015419+0000 mon.c (mon.2) 60 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:09.022903+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[26514]: audit 2024-09-21T05:01:09.102879+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:09.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.514098587Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-21T05:01:09.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.615060904Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-21T05:01:09.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.682344158Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: cluster 2024-09-21T05:01:08.398312+0000 mgr.y (mgr.14385) 58 : cluster [DBG] pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.935610+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.947967+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.954343+0000 mon.c (mon.2) 55 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.956648+0000 mon.c (mon.2) 56 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.962586+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.983915+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.989736+0000 mon.c (mon.2) 58 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:08.995508+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:09.009767+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:09.015419+0000 mon.c (mon.2) 60 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:09.022903+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:09.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[22020]: audit 2024-09-21T05:01:09.102879+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:01:10.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:09 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:09.925354776Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-21T05:01:10.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.067688097Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-21T05:01:10.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.134808688Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T05:01:10.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.194234395Z level=info msg="Executing migration" id="Drop public config table" 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STOPPED 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:09 smithi089 bash[20084]: [21/Sep/2024:05:01:09] ENGINE Bus STARTING 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Serving on http://:::9283 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Bus STARTED 2024-09-21T05:01:10.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Bus STOPPING 2024-09-21T05:01:10.470 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.294703287Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-21T05:01:10.470 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.355813995Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-21T05:01:10.470 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.428786664Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:08.954871+0000 mgr.y (mgr.14385) 59 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:08.957050+0000 mgr.y (mgr.14385) 60 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:08.984538+0000 mgr.y (mgr.14385) 61 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:08.990241+0000 mgr.y (mgr.14385) 62 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:09.010694+0000 mgr.y (mgr.14385) 63 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[19831]: audit 2024-09-21T05:01:09.016175+0000 mgr.y (mgr.14385) 64 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Bus STOPPED 2024-09-21T05:01:10.685 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Bus STARTING 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Serving on http://:::9283 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[20084]: [21/Sep/2024:05:01:10] ENGINE Bus STARTED 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:08.954871+0000 mgr.y (mgr.14385) 59 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:08.957050+0000 mgr.y (mgr.14385) 60 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:08.984538+0000 mgr.y (mgr.14385) 61 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:08.990241+0000 mgr.y (mgr.14385) 62 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:09.010694+0000 mgr.y (mgr.14385) 63 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:10.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:10 smithi089 bash[26514]: audit 2024-09-21T05:01:09.016175+0000 mgr.y (mgr.14385) 64 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:10.722 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.513083533Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-21T05:01:10.723 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.60214673Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-21T05:01:10.723 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.646890498Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-21T05:01:10.723 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.680825147Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:08.954871+0000 mgr.y (mgr.14385) 59 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:08.957050+0000 mgr.y (mgr.14385) 60 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:08.984538+0000 mgr.y (mgr.14385) 61 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:08.990241+0000 mgr.y (mgr.14385) 62 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi110.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:09.010694+0000 mgr.y (mgr.14385) 63 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:01:10.723 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[22020]: audit 2024-09-21T05:01:09.016175+0000 mgr.y (mgr.14385) 64 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi110.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.709Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.709Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.709Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.709Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.709Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.711Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.711Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.713Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.713Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.715Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.715Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.824µs 2024-09-21T05:01:10.724 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.715Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.715Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.716Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.716Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=22.626µs wal_replay_duration=687.169µs wbl_replay_duration=127ns total_replay_duration=730.117µs 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.717Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.717Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:01:10.725 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.717Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:01:10.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.741Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.718938ms db_storage=872ns remote_storage=1.161µs web_handler=395ns query_engine=559ns scrape=248.722µs scrape_sd=128.636µs notify=14.752µs notify_sd=29.84µs rules=22.874669ms tracing=9.621µs 2024-09-21T05:01:10.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.741Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:01:10.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47732]: ts=2024-09-21T05:01:10.741Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.722916236Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.782196143Z level=info msg="Executing migration" id="add share column" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.807530238Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.832722644Z level=info msg="Executing migration" id="create file table" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.858147443Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.883320206Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-21T05:01:10.976 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.908710556Z level=info msg="Executing migration" id="create file_meta table" 2024-09-21T05:01:10.977 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.933807077Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-21T05:01:10.977 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:10 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:10.97587298Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-21T05:01:11.253 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.001131065Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-21T05:01:11.253 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.043024751Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.085320788Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.111223864Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.144196072Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.169485391Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.194799086Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-21T05:01:11.254 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.254150214Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-21T05:01:11.521 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[22020]: cluster 2024-09-21T05:01:10.398873+0000 mgr.y (mgr.14385) 65 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:11.521 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[22020]: audit 2024-09-21T05:01:10.460029+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.278789042Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.304006456Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.345941348Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.3712434Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.413334233Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-21T05:01:11.522 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.497213261Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-21T05:01:11.722 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:11 smithi089 bash[26514]: cluster 2024-09-21T05:01:10.398873+0000 mgr.y (mgr.14385) 65 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:11.722 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:11 smithi089 bash[26514]: audit 2024-09-21T05:01:10.460029+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:11.722 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:11 smithi089 bash[19831]: cluster 2024-09-21T05:01:10.398873+0000 mgr.y (mgr.14385) 65 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:11.722 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:11 smithi089 bash[19831]: audit 2024-09-21T05:01:10.460029+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.522471264Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.547760552Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.606500153Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.631565414Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.673709147Z level=info msg="Executing migration" id="create folder table" 2024-09-21T05:01:11.774 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.69881743Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-21T05:01:11.775 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.724072614Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-21T05:01:11.775 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.749457087Z level=info msg="Executing migration" id="Update folder title length" 2024-09-21T05:01:11.775 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.774740205Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=migrator t=2024-09-21T05:01:11.799874007Z level=info msg="migrations completed" performed=485 skipped=0 duration=21.093383607s 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=sqlstore t=2024-09-21T05:01:11.800740563Z level=info msg="Created default organization" 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=plugin.finder t=2024-09-21T05:01:11.903467602Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=secrets t=2024-09-21T05:01:11.903813033Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=query_data t=2024-09-21T05:01:11.908923488Z level=info msg="Query Service initialization" 2024-09-21T05:01:12.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:11 smithi110 bash[47061]: logger=live.push_http t=2024-09-21T05:01:11.915043088Z level=info msg="Live Push Gateway initialization" 2024-09-21T05:01:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:236223201304 2024-09-21T05:01:13.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T05:01:13.228 INFO:teuthology.orchestra.run.smithi089.stdout:167503724589 2024-09-21T05:01:13.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T05:01:13.287 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:12 smithi110 bash[47061]: logger=infra.usagestats.collector t=2024-09-21T05:01:12.914345656Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:12 smithi110 bash[47061]: logger=provisioning.datasources t=2024-09-21T05:01:12.916325483Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:12 smithi110 bash[47061]: logger=provisioning.datasources t=2024-09-21T05:01:12.96785412Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=provisioning.alerting t=2024-09-21T05:01:13.035045223Z level=info msg="starting to provision alerting" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=provisioning.alerting t=2024-09-21T05:01:13.035074116Z level=info msg="finished to provision alerting" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=ngalert.state.manager t=2024-09-21T05:01:13.035445487Z level=info msg="Warming state cache for startup" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=ngalert.state.manager t=2024-09-21T05:01:13.0359055Z level=info msg="State cache has been initialized" states=0 duration=456.14µs 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=ticker t=2024-09-21T05:01:13.036410138Z level=info msg=starting first_tick=2024-09-21T05:01:20Z 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=ngalert.multiorg.alertmanager t=2024-09-21T05:01:13.036508264Z level=info msg="starting MultiOrg Alertmanager" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=grafanaStorageLogger t=2024-09-21T05:01:13.036810185Z level=info msg="storage starting" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=http.server t=2024-09-21T05:01:13.038386022Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.288139968Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T05:01:13.288 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.28819927Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T05:01:13.356 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:01:13 smithi089 bash[51498]: ts=2024-09-21T05:01:13.318Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003093157s 2024-09-21T05:01:13.475 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:13 smithi089 bash[26514]: cluster 2024-09-21T05:01:12.399526+0000 mgr.y (mgr.14385) 66 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:13.538 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[22020]: cluster 2024-09-21T05:01:12.399526+0000 mgr.y (mgr.14385) 66 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:13.539 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.439208869Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-21T05:01:13.539 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.483776303Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T05:01:13.539 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.528570457Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-21T05:01:13.690 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:13 smithi089 bash[19831]: cluster 2024-09-21T05:01:12.399526+0000 mgr.y (mgr.14385) 66 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:13.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.539624706Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-09-21T05:01:13.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.550915672Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=3 code="database is locked" 2024-09-21T05:01:13.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:01:13.615971341Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=4 code="database is locked" 2024-09-21T05:01:13.805 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:01:13 smithi110 bash[47061]: logger=dashboard-service t=2024-09-21T05:01:13.616804231Z level=error msg="Could not make user admin" dashboard="OSD device details" user=0 error="database is locked" 2024-09-21T05:01:14.584 INFO:teuthology.orchestra.run.smithi089.stdout:55834574938 2024-09-21T05:01:14.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T05:01:14.623 INFO:teuthology.orchestra.run.smithi089.stdout:201863462947 2024-09-21T05:01:14.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T05:01:15.759 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:15 smithi089 bash[19831]: cluster 2024-09-21T05:01:14.400067+0000 mgr.y (mgr.14385) 67 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:15.759 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:15 smithi089 bash[26514]: cluster 2024-09-21T05:01:14.400067+0000 mgr.y (mgr.14385) 67 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:15 smithi110 bash[22020]: cluster 2024-09-21T05:01:14.400067+0000 mgr.y (mgr.14385) 67 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:15.993 INFO:teuthology.orchestra.run.smithi089.stdout:133143986232 2024-09-21T05:01:15.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T05:01:16.164 INFO:teuthology.orchestra.run.smithi089.stdout:111669149763 2024-09-21T05:01:16.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T05:01:16.832 INFO:teuthology.orchestra.run.smithi089.stdout:77309411407 2024-09-21T05:01:16.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T05:01:16.836 INFO:teuthology.orchestra.run.smithi089.stdout:34359738468 2024-09-21T05:01:16.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[19831]: audit 2024-09-21T05:01:15.952821+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[19831]: audit 2024-09-21T05:01:15.964720+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[19831]: cluster 2024-09-21T05:01:16.400572+0000 mgr.y (mgr.14385) 68 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[26514]: audit 2024-09-21T05:01:15.952821+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[26514]: audit 2024-09-21T05:01:15.964720+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:16 smithi089 bash[26514]: cluster 2024-09-21T05:01:16.400572+0000 mgr.y (mgr.14385) 68 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:16 smithi110 bash[22020]: audit 2024-09-21T05:01:15.952821+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:16 smithi110 bash[22020]: audit 2024-09-21T05:01:15.964720+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:16 smithi110 bash[22020]: cluster 2024-09-21T05:01:16.400572+0000 mgr.y (mgr.14385) 68 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:19.147 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:19.147 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:19.148 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:19.148 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:19.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:19 smithi089 bash[19831]: cluster 2024-09-21T05:01:18.401112+0000 mgr.y (mgr.14385) 69 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:19.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:19 smithi089 bash[26514]: cluster 2024-09-21T05:01:18.401112+0000 mgr.y (mgr.14385) 69 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:19 smithi110 bash[22020]: cluster 2024-09-21T05:01:18.401112+0000 mgr.y (mgr.14385) 69 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:20.155 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:20.155 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:20 smithi110 bash[22020]: audit 2024-09-21T05:01:19.635355+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:20 smithi110 bash[22020]: audit 2024-09-21T05:01:19.640704+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:20 smithi110 bash[22020]: audit 2024-09-21T05:01:20.240068+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:20 smithi110 bash[22020]: audit 2024-09-21T05:01:20.241166+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:20 smithi110 bash[22020]: audit 2024-09-21T05:01:20.247574+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[19831]: audit 2024-09-21T05:01:19.635355+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[19831]: audit 2024-09-21T05:01:19.640704+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[19831]: audit 2024-09-21T05:01:20.240068+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[19831]: audit 2024-09-21T05:01:20.241166+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[19831]: audit 2024-09-21T05:01:20.247574+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[26514]: audit 2024-09-21T05:01:19.635355+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[26514]: audit 2024-09-21T05:01:19.640704+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[26514]: audit 2024-09-21T05:01:20.240068+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[26514]: audit 2024-09-21T05:01:20.241166+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:01:21.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:20 smithi089 bash[26514]: audit 2024-09-21T05:01:20.247574+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:21.172 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:21.174 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:22.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:21 smithi089 bash[19831]: cluster 2024-09-21T05:01:20.401702+0000 mgr.y (mgr.14385) 70 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:22.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:01:21] "GET /metrics HTTP/1.1" 200 26214 "" "Prometheus/2.43.0" 2024-09-21T05:01:22.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:21 smithi089 bash[26514]: cluster 2024-09-21T05:01:20.401702+0000 mgr.y (mgr.14385) 70 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:21 smithi110 bash[22020]: cluster 2024-09-21T05:01:20.401702+0000 mgr.y (mgr.14385) 70 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:23.611 INFO:teuthology.orchestra.run.smithi089.stdout:236223201307 2024-09-21T05:01:23.648 INFO:teuthology.orchestra.run.smithi089.stdout:111669149765 2024-09-21T05:01:23.879 INFO:teuthology.orchestra.run.smithi089.stdout:167503724592 2024-09-21T05:01:23.891 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:23 smithi089 bash[19831]: cluster 2024-09-21T05:01:22.402275+0000 mgr.y (mgr.14385) 71 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:23.891 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:23 smithi089 bash[19831]: audit 2024-09-21T05:01:23.612678+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.89:0/2821790067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-21T05:01:23.891 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:23 smithi089 bash[26514]: cluster 2024-09-21T05:01:22.402275+0000 mgr.y (mgr.14385) 71 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:23.891 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:23 smithi089 bash[26514]: audit 2024-09-21T05:01:23.612678+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.89:0/2821790067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-21T05:01:23.929 INFO:teuthology.orchestra.run.smithi089.stdout:201863462949 2024-09-21T05:01:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:23 smithi110 bash[22020]: cluster 2024-09-21T05:01:22.402275+0000 mgr.y (mgr.14385) 71 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:24.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:23 smithi110 bash[22020]: audit 2024-09-21T05:01:23.612678+0000 mon.a (mon.0) 736 : audit [DBG] from='client.? 172.21.15.89:0/2821790067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-21T05:01:24.285 INFO:teuthology.orchestra.run.smithi089.stdout:55834574940 2024-09-21T05:01:24.337 INFO:teuthology.orchestra.run.smithi089.stdout:77309411409 2024-09-21T05:01:24.622 INFO:teuthology.orchestra.run.smithi089.stdout:133143986234 2024-09-21T05:01:24.913 INFO:teuthology.orchestra.run.smithi089.stdout:34359738470 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:23.649960+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.89:0/2565110707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:23.880786+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.15.89:0/68545600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:23.931398+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.89:0/965671871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:24.286995+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.89:0/3695147639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:24.339170+0000 mon.a (mon.0) 739 : audit [DBG] from='client.? 172.21.15.89:0/2077272214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[19831]: audit 2024-09-21T05:01:24.624143+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.89:0/2456720068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T05:01:24.954 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:23.649960+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.89:0/2565110707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T05:01:24.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:23.880786+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.15.89:0/68545600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T05:01:24.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:23.931398+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.89:0/965671871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-21T05:01:24.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:24.286995+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.89:0/3695147639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T05:01:24.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:24.339170+0000 mon.a (mon.0) 739 : audit [DBG] from='client.? 172.21.15.89:0/2077272214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T05:01:24.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:24 smithi089 bash[26514]: audit 2024-09-21T05:01:24.624143+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.89:0/2456720068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T05:01:25.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:23.649960+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.89:0/2565110707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T05:01:25.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:23.880786+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.15.89:0/68545600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T05:01:25.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:23.931398+0000 mon.a (mon.0) 738 : audit [DBG] from='client.? 172.21.15.89:0/965671871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-21T05:01:25.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:24.286995+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.89:0/3695147639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T05:01:25.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:24.339170+0000 mon.a (mon.0) 739 : audit [DBG] from='client.? 172.21.15.89:0/2077272214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T05:01:25.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:24 smithi110 bash[22020]: audit 2024-09-21T05:01:24.624143+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? 172.21.15.89:0/2456720068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[26514]: cluster 2024-09-21T05:01:24.402597+0000 mgr.y (mgr.14385) 72 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[26514]: audit 2024-09-21T05:01:24.915045+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.89:0/3534790147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[26514]: audit 2024-09-21T05:01:25.460866+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[19831]: cluster 2024-09-21T05:01:24.402597+0000 mgr.y (mgr.14385) 72 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[19831]: audit 2024-09-21T05:01:24.915045+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.89:0/3534790147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T05:01:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:25 smithi089 bash[19831]: audit 2024-09-21T05:01:25.460866+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:25 smithi110 bash[22020]: cluster 2024-09-21T05:01:24.402597+0000 mgr.y (mgr.14385) 72 : cluster [DBG] pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:25 smithi110 bash[22020]: audit 2024-09-21T05:01:24.915045+0000 mon.a (mon.0) 740 : audit [DBG] from='client.? 172.21.15.89:0/3534790147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T05:01:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:25 smithi110 bash[22020]: audit 2024-09-21T05:01:25.460866+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:26.249 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201304 got 236223201307 for osd.7 2024-09-21T05:01:26.249 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:26.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724589 got 167503724592 for osd.5 2024-09-21T05:01:26.321 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:26.342 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149763 got 111669149765 for osd.3 2024-09-21T05:01:26.342 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:26.789 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:26 smithi089 bash[19831]: cluster 2024-09-21T05:01:26.403157+0000 mgr.y (mgr.14385) 73 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:26.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462947 got 201863462949 for osd.6 2024-09-21T05:01:26.850 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:26 smithi110 bash[22020]: cluster 2024-09-21T05:01:26.403157+0000 mgr.y (mgr.14385) 73 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:27.081 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:26 smithi089 bash[26514]: cluster 2024-09-21T05:01:26.403157+0000 mgr.y (mgr.14385) 73 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:27.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986234 for osd.4 2024-09-21T05:01:27.598 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:27.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411407 got 77309411409 for osd.2 2024-09-21T05:01:27.921 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:28.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738468 got 34359738470 for osd.0 2024-09-21T05:01:28.410 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:28.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574938 got 55834574940 for osd.1 2024-09-21T05:01:28.428 DEBUG:teuthology.parallel:result is None 2024-09-21T05:01:28.428 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T05:01:28.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:01:29.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:29 smithi089 bash[19831]: cluster 2024-09-21T05:01:28.403717+0000 mgr.y (mgr.14385) 74 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:29.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:29 smithi089 bash[26514]: cluster 2024-09-21T05:01:28.403717+0000 mgr.y (mgr.14385) 74 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:29 smithi110 bash[22020]: cluster 2024-09-21T05:01:28.403717+0000 mgr.y (mgr.14385) 74 : cluster [DBG] pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:31.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:31 smithi089 bash[19831]: cluster 2024-09-21T05:01:30.404312+0000 mgr.y (mgr.14385) 75 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:31.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:31 smithi089 bash[26514]: cluster 2024-09-21T05:01:30.404312+0000 mgr.y (mgr.14385) 75 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:31 smithi110 bash[22020]: cluster 2024-09-21T05:01:30.404312+0000 mgr.y (mgr.14385) 75 : cluster [DBG] pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:32.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:01:31] "GET /metrics HTTP/1.1" 200 26211 "" "Prometheus/2.43.0" 2024-09-21T05:01:33.256 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:33.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:33 smithi089 bash[19831]: cluster 2024-09-21T05:01:32.404924+0000 mgr.y (mgr.14385) 76 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:33 smithi089 bash[26514]: cluster 2024-09-21T05:01:32.404924+0000 mgr.y (mgr.14385) 76 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:33 smithi110 bash[22020]: cluster 2024-09-21T05:01:32.404924+0000 mgr.y (mgr.14385) 76 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:34.720 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:01:34.720 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-21T05:01:35.380 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-21T05:01:34.405246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":239240,"kb_used_data":6380,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749721976,"statfs":{"total":767960285184,"available":767715303424,"internally_reserved":0,"allocated":6533120,"data_stored":3703392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":253,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-21T05:00:12.515444+0000","last_change":"2024-09-21T04:59:24.856589+0000","last_active":"2024-09-21T05:00:12.515444+0000","last_peered":"2024-09-21T05:00:12.515444+0000","last_clean":"2024-09-21T05:00:12.515444+0000","last_became_active":"2024-09-21T04:59:24.855591+0000","last_became_peered":"2024-09-21T04:59:24.855591+0000","last_unstale":"2024-09-21T05:00:12.515444+0000","last_undegraded":"2024-09-21T05:00:12.515444+0000","last_fullsized":"2024-09-21T05:00:12.515444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:54:53.184924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:54:53.184924+0000","last_clean_scrub_stamp":"2024-09-21T04:54:53.184924+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:21.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201309,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712808,"statfs":{"total":95995035648,"available":95961915392,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149767,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28188,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716964,"statfs":{"total":95995035648,"available":95966171136,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:01:35.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T05:01:35.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:35 smithi089 bash[19831]: cluster 2024-09-21T05:01:34.405523+0000 mgr.y (mgr.14385) 77 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:35.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:35 smithi089 bash[26514]: cluster 2024-09-21T05:01:34.405523+0000 mgr.y (mgr.14385) 77 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:35 smithi110 bash[22020]: cluster 2024-09-21T05:01:34.405523+0000 mgr.y (mgr.14385) 77 : cluster [DBG] pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:36.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:36 smithi089 bash[19831]: audit 2024-09-21T05:01:34.720247+0000 mgr.y (mgr.14385) 78 : audit [DBG] from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:36 smithi089 bash[26514]: audit 2024-09-21T05:01:34.720247+0000 mgr.y (mgr.14385) 78 : audit [DBG] from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:36 smithi110 bash[22020]: audit 2024-09-21T05:01:34.720247+0000 mgr.y (mgr.14385) 78 : audit [DBG] from='client.24458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:37.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:37 smithi089 bash[19831]: cluster 2024-09-21T05:01:36.406068+0000 mgr.y (mgr.14385) 79 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:37.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:37 smithi089 bash[26514]: cluster 2024-09-21T05:01:36.406068+0000 mgr.y (mgr.14385) 79 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:37 smithi110 bash[22020]: cluster 2024-09-21T05:01:36.406068+0000 mgr.y (mgr.14385) 79 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:39.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:39 smithi089 bash[19831]: cluster 2024-09-21T05:01:38.406591+0000 mgr.y (mgr.14385) 80 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:39.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:39 smithi089 bash[26514]: cluster 2024-09-21T05:01:38.406591+0000 mgr.y (mgr.14385) 80 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:39 smithi110 bash[22020]: cluster 2024-09-21T05:01:38.406591+0000 mgr.y (mgr.14385) 80 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:40.168 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:40.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:40 smithi089 bash[19831]: audit 2024-09-21T05:01:40.461312+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:40.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:40 smithi089 bash[26514]: audit 2024-09-21T05:01:40.461312+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:40 smithi110 bash[22020]: audit 2024-09-21T05:01:40.461312+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:41.642 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-21T05:01:41.642 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:01:41.655 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:41 smithi089 bash[19831]: cluster 2024-09-21T05:01:40.407171+0000 mgr.y (mgr.14385) 81 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:41.655 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:41 smithi089 bash[26514]: cluster 2024-09-21T05:01:40.407171+0000 mgr.y (mgr.14385) 81 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:41 smithi110 bash[22020]: cluster 2024-09-21T05:01:40.407171+0000 mgr.y (mgr.14385) 81 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:42.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:01:41] "GET /metrics HTTP/1.1" 200 26210 "" "Prometheus/2.43.0" 2024-09-21T05:01:42.316 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-21T05:01:40.406908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":239240,"kb_used_data":6380,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":749721976,"statfs":{"total":767960285184,"available":767715303424,"internally_reserved":0,"allocated":6533120,"data_stored":3703392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003452"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":253,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-21T05:00:12.515444+0000","last_change":"2024-09-21T04:59:24.856589+0000","last_active":"2024-09-21T05:00:12.515444+0000","last_peered":"2024-09-21T05:00:12.515444+0000","last_clean":"2024-09-21T05:00:12.515444+0000","last_became_active":"2024-09-21T04:59:24.855591+0000","last_became_peered":"2024-09-21T04:59:24.855591+0000","last_unstale":"2024-09-21T05:00:12.515444+0000","last_undegraded":"2024-09-21T05:00:12.515444+0000","last_fullsized":"2024-09-21T05:00:12.515444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:54:53.184924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:54:53.184924+0000","last_clean_scrub_stamp":"2024-09-21T04:54:53.184924+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:21.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712808,"statfs":{"total":95995035648,"available":95961915392,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27608,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717544,"statfs":{"total":95995035648,"available":95966765056,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31768,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713384,"statfs":{"total":95995035648,"available":95962505216,"internally_reserved":0,"allocated":593920,"data_stored":241536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28188,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716964,"statfs":{"total":95995035648,"available":95966171136,"internally_reserved":0,"allocated":1187840,"data_stored":831904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T05:01:42.317 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T05:01:42.317 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T05:01:42.317 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T05:01:42.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T05:01:42.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:42 smithi089 bash[19831]: audit 2024-09-21T05:01:41.642874+0000 mgr.y (mgr.14385) 82 : audit [DBG] from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:42 smithi089 bash[26514]: audit 2024-09-21T05:01:41.642874+0000 mgr.y (mgr.14385) 82 : audit [DBG] from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:42 smithi110 bash[22020]: audit 2024-09-21T05:01:41.642874+0000 mgr.y (mgr.14385) 82 : audit [DBG] from='client.24464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T05:01:43.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:43 smithi089 bash[19831]: cluster 2024-09-21T05:01:42.407785+0000 mgr.y (mgr.14385) 83 : cluster [DBG] pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:43.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:43 smithi089 bash[26514]: cluster 2024-09-21T05:01:42.407785+0000 mgr.y (mgr.14385) 83 : cluster [DBG] pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:43.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:43 smithi110 bash[22020]: cluster 2024-09-21T05:01:42.407785+0000 mgr.y (mgr.14385) 83 : cluster [DBG] pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:45.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:45 smithi089 bash[19831]: cluster 2024-09-21T05:01:44.408465+0000 mgr.y (mgr.14385) 84 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:45.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:45 smithi089 bash[26514]: cluster 2024-09-21T05:01:44.408465+0000 mgr.y (mgr.14385) 84 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:45 smithi110 bash[22020]: cluster 2024-09-21T05:01:44.408465+0000 mgr.y (mgr.14385) 84 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:47.093 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:47.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:47 smithi089 bash[19831]: cluster 2024-09-21T05:01:46.409098+0000 mgr.y (mgr.14385) 85 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:47.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:47 smithi089 bash[26514]: cluster 2024-09-21T05:01:46.409098+0000 mgr.y (mgr.14385) 85 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:47 smithi110 bash[22020]: cluster 2024-09-21T05:01:46.409098+0000 mgr.y (mgr.14385) 85 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:48.603 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:01:48.603 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T05:01:49.260 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T05:01:49.260 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T05:01:49.260 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:01:49.273 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T05:01:49.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-09-21T05:01:49.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:49 smithi089 bash[26514]: cluster 2024-09-21T05:01:48.409427+0000 mgr.y (mgr.14385) 86 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:49 smithi089 bash[26514]: audit 2024-09-21T05:01:48.604358+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.89:0/201998702' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T05:01:49.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:49 smithi089 bash[19831]: cluster 2024-09-21T05:01:48.409427+0000 mgr.y (mgr.14385) 86 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:49.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:49 smithi089 bash[19831]: audit 2024-09-21T05:01:48.604358+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.89:0/201998702' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T05:01:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:49 smithi110 bash[22020]: cluster 2024-09-21T05:01:48.409427+0000 mgr.y (mgr.14385) 86 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:49 smithi110 bash[22020]: audit 2024-09-21T05:01:48.604358+0000 mon.c (mon.2) 70 : audit [DBG] from='client.? 172.21.15.89:0/201998702' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T05:01:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:51 smithi089 bash[19831]: cluster 2024-09-21T05:01:50.410041+0000 mgr.y (mgr.14385) 87 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:51 smithi089 bash[26514]: cluster 2024-09-21T05:01:50.410041+0000 mgr.y (mgr.14385) 87 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:51 smithi110 bash[22020]: cluster 2024-09-21T05:01:50.410041+0000 mgr.y (mgr.14385) 87 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:52.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:01:51] "GET /metrics HTTP/1.1" 200 26210 "" "Prometheus/2.43.0" 2024-09-21T05:01:53.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:53 smithi089 bash[19831]: cluster 2024-09-21T05:01:52.410698+0000 mgr.y (mgr.14385) 88 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:53.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:53 smithi089 bash[26514]: cluster 2024-09-21T05:01:52.410698+0000 mgr.y (mgr.14385) 88 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:53.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:53 smithi110 bash[22020]: cluster 2024-09-21T05:01:52.410698+0000 mgr.y (mgr.14385) 88 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:54.052 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:01:55.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[19831]: cluster 2024-09-21T05:01:54.411256+0000 mgr.y (mgr.14385) 89 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[19831]: audit 2024-09-21T05:01:55.461640+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[19831]: audit 2024-09-21T05:01:55.529700+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.89:0/3388820694' entity='client.admin' 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE Bus STOPPING 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[26514]: cluster 2024-09-21T05:01:54.411256+0000 mgr.y (mgr.14385) 89 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[26514]: audit 2024-09-21T05:01:55.461640+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:55.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[26514]: audit 2024-09-21T05:01:55.529700+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.89:0/3388820694' entity='client.admin' 2024-09-21T05:01:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:55 smithi110 bash[22020]: cluster 2024-09-21T05:01:54.411256+0000 mgr.y (mgr.14385) 89 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:55 smithi110 bash[22020]: audit 2024-09-21T05:01:55.461640+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:01:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:55 smithi110 bash[22020]: audit 2024-09-21T05:01:55.529700+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.89:0/3388820694' entity='client.admin' 2024-09-21T05:01:56.212 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:01:56.213 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE Bus STOPPED 2024-09-21T05:01:56.213 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE Bus STARTING 2024-09-21T05:01:56.213 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE Serving on http://:::9283 2024-09-21T05:01:56.213 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:01:55 smithi089 bash[20084]: [21/Sep/2024:05:01:55] ENGINE Bus STARTED 2024-09-21T05:01:56.214 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T05:01:56.226 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T05:01:56.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-09-21T05:01:57.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[19831]: audit 2024-09-21T05:01:56.093434+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[19831]: audit 2024-09-21T05:01:56.104684+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[19831]: cluster 2024-09-21T05:01:56.411663+0000 mgr.y (mgr.14385) 90 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:57.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[26514]: audit 2024-09-21T05:01:56.093434+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[26514]: audit 2024-09-21T05:01:56.104684+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:57 smithi089 bash[26514]: cluster 2024-09-21T05:01:56.411663+0000 mgr.y (mgr.14385) 90 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:57.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:57 smithi110 bash[22020]: audit 2024-09-21T05:01:56.093434+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:57 smithi110 bash[22020]: audit 2024-09-21T05:01:56.104684+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:01:57.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:57 smithi110 bash[22020]: cluster 2024-09-21T05:01:56.411663+0000 mgr.y (mgr.14385) 90 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:59.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:01:59 smithi089 bash[19831]: cluster 2024-09-21T05:01:58.412134+0000 mgr.y (mgr.14385) 91 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:59.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:01:59 smithi089 bash[26514]: cluster 2024-09-21T05:01:58.412134+0000 mgr.y (mgr.14385) 91 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:01:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:01:59 smithi110 bash[22020]: cluster 2024-09-21T05:01:58.412134+0000 mgr.y (mgr.14385) 91 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:00.595 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:01.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[26514]: cluster 2024-09-21T05:02:00.412692+0000 mgr.y (mgr.14385) 92 : cluster [DBG] pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:01.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[26514]: audit 2024-09-21T05:02:01.121065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:01.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[26514]: audit 2024-09-21T05:02:01.127043+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:01.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[19831]: cluster 2024-09-21T05:02:00.412692+0000 mgr.y (mgr.14385) 92 : cluster [DBG] pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:01.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[19831]: audit 2024-09-21T05:02:01.121065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:01.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[19831]: audit 2024-09-21T05:02:01.127043+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:01.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:01 smithi110 bash[22020]: cluster 2024-09-21T05:02:00.412692+0000 mgr.y (mgr.14385) 92 : cluster [DBG] pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:01.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:01 smithi110 bash[22020]: audit 2024-09-21T05:02:01.121065+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:01.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:01 smithi110 bash[22020]: audit 2024-09-21T05:02:01.127043+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:02.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:01] "GET /metrics HTTP/1.1" 200 26207 "" "Prometheus/2.43.0" 2024-09-21T05:02:03.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.259363+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.271122+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: cluster 2024-09-21T05:02:02.413250+0000 mgr.y (mgr.14385) 93 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: cluster 2024-09-21T05:02:02.481526+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.486480+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.89:0/945026406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.487051+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.982055+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.983887+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[26514]: audit 2024-09-21T05:02:02.994223+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.259363+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.271122+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: cluster 2024-09-21T05:02:02.413250+0000 mgr.y (mgr.14385) 93 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: cluster 2024-09-21T05:02:02.481526+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-21T05:02:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.486480+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.89:0/945026406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.487051+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.982055+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.983887+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:03.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:03 smithi089 bash[19831]: audit 2024-09-21T05:02:02.994223+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.259363+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.271122+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: cluster 2024-09-21T05:02:02.413250+0000 mgr.y (mgr.14385) 93 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: cluster 2024-09-21T05:02:02.481526+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.486480+0000 mon.c (mon.2) 72 : audit [INF] from='client.? 172.21.15.89:0/945026406' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.487051+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-21T05:02:03.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.982055+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:03.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.983887+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:03.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:03 smithi110 bash[22020]: audit 2024-09-21T05:02:02.994223+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "1b03e0a8-38fd-49a1-a409-bacc87f26245", 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "r", 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout: "current_period": "acbf5353-7232-4591-a27c-4cf3a1088a7a", 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 1 2024-09-21T05:02:03.556 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:02:04.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-09-21T05:02:04.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:04 smithi089 bash[26514]: audit 2024-09-21T05:02:03.477674+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T05:02:04.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:04 smithi089 bash[26514]: cluster 2024-09-21T05:02:03.486279+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-21T05:02:04.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:04 smithi089 bash[19831]: audit 2024-09-21T05:02:03.477674+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T05:02:04.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:04 smithi089 bash[19831]: cluster 2024-09-21T05:02:03.486279+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-21T05:02:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:04 smithi110 bash[22020]: audit 2024-09-21T05:02:03.477674+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-21T05:02:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:04 smithi110 bash[22020]: cluster 2024-09-21T05:02:03.486279+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-21T05:02:05.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:05 smithi089 bash[26514]: cluster 2024-09-21T05:02:04.413640+0000 mgr.y (mgr.14385) 94 : cluster [DBG] pgmap v62: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:05.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:05 smithi089 bash[26514]: cluster 2024-09-21T05:02:04.497491+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-21T05:02:05.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:05 smithi089 bash[19831]: cluster 2024-09-21T05:02:04.413640+0000 mgr.y (mgr.14385) 94 : cluster [DBG] pgmap v62: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:05.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:05 smithi089 bash[19831]: cluster 2024-09-21T05:02:04.497491+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-21T05:02:05.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:05 smithi110 bash[22020]: cluster 2024-09-21T05:02:04.413640+0000 mgr.y (mgr.14385) 94 : cluster [DBG] pgmap v62: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:05.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:05 smithi110 bash[22020]: cluster 2024-09-21T05:02:04.497491+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-21T05:02:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:07 smithi089 bash[19831]: cluster 2024-09-21T05:02:06.414313+0000 mgr.y (mgr.14385) 95 : cluster [DBG] pgmap v64: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:07.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:07 smithi089 bash[26514]: cluster 2024-09-21T05:02:06.414313+0000 mgr.y (mgr.14385) 95 : cluster [DBG] pgmap v64: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:07 smithi110 bash[22020]: cluster 2024-09-21T05:02:06.414313+0000 mgr.y (mgr.14385) 95 : cluster [DBG] pgmap v64: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:08.994 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:09.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:09 smithi089 bash[19831]: cluster 2024-09-21T05:02:08.414913+0000 mgr.y (mgr.14385) 96 : cluster [DBG] pgmap v65: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:09.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:09 smithi089 bash[26514]: cluster 2024-09-21T05:02:08.414913+0000 mgr.y (mgr.14385) 96 : cluster [DBG] pgmap v65: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:09 smithi110 bash[22020]: cluster 2024-09-21T05:02:08.414913+0000 mgr.y (mgr.14385) 96 : cluster [DBG] pgmap v65: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "59dd792d-3c65-420a-b50f-685906209a8f", 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "default", 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "api_name": "default", 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "is_master": true, 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "endpoints": [], 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "hostnames": [], 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "hostnames_s3website": [], 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "master_zone": "", 2024-09-21T05:02:10.108 INFO:teuthology.orchestra.run.smithi089.stdout: "zones": [], 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "placement_targets": [ 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "default-placement", 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "tags": [], 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "storage_classes": [] 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "default_placement": "default-placement", 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "realm_id": "1b03e0a8-38fd-49a1-a409-bacc87f26245", 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "sync_policy": { 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "groups": [] 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled_features": [ 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "notification_v2", 2024-09-21T05:02:10.109 INFO:teuthology.orchestra.run.smithi089.stdout: "resharding" 2024-09-21T05:02:10.110 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T05:02:10.110 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:02:10.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[19831]: audit 2024-09-21T05:02:10.429452+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[19831]: audit 2024-09-21T05:02:10.430245+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[19831]: audit 2024-09-21T05:02:10.465849+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:10.787 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[26514]: audit 2024-09-21T05:02:10.429452+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.787 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[26514]: audit 2024-09-21T05:02:10.430245+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.787 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:10 smithi089 bash[26514]: audit 2024-09-21T05:02:10.465849+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:10.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-09-21T05:02:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:10 smithi110 bash[22020]: audit 2024-09-21T05:02:10.429452+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:10 smithi110 bash[22020]: audit 2024-09-21T05:02:10.430245+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-09-21T05:02:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:10 smithi110 bash[22020]: audit 2024-09-21T05:02:10.465849+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:11.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[19831]: cluster 2024-09-21T05:02:10.415578+0000 mgr.y (mgr.14385) 97 : cluster [DBG] pgmap v66: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 902 B/s wr, 2 op/s 2024-09-21T05:02:11.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[19831]: audit 2024-09-21T05:02:10.510620+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-21T05:02:11.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[19831]: cluster 2024-09-21T05:02:10.519798+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-21T05:02:11.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[26514]: cluster 2024-09-21T05:02:10.415578+0000 mgr.y (mgr.14385) 97 : cluster [DBG] pgmap v66: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 902 B/s wr, 2 op/s 2024-09-21T05:02:11.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[26514]: audit 2024-09-21T05:02:10.510620+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-21T05:02:11.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[26514]: cluster 2024-09-21T05:02:10.519798+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-21T05:02:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:11 smithi110 bash[22020]: cluster 2024-09-21T05:02:10.415578+0000 mgr.y (mgr.14385) 97 : cluster [DBG] pgmap v66: 33 pgs: 33 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 257 B/s rd, 902 B/s wr, 2 op/s 2024-09-21T05:02:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:11 smithi110 bash[22020]: audit 2024-09-21T05:02:10.510620+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2024-09-21T05:02:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:11 smithi110 bash[22020]: cluster 2024-09-21T05:02:10.519798+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-21T05:02:12.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:11] "GET /metrics HTTP/1.1" 200 28530 "" "Prometheus/2.43.0" 2024-09-21T05:02:12.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:12 smithi089 bash[19831]: cluster 2024-09-21T05:02:11.521333+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-21T05:02:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:12 smithi089 bash[26514]: cluster 2024-09-21T05:02:11.521333+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-21T05:02:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:12 smithi110 bash[22020]: cluster 2024-09-21T05:02:11.521333+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-21T05:02:13.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:13 smithi089 bash[19831]: cluster 2024-09-21T05:02:12.416213+0000 mgr.y (mgr.14385) 98 : cluster [DBG] pgmap v69: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-21T05:02:13.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:13 smithi089 bash[26514]: cluster 2024-09-21T05:02:12.416213+0000 mgr.y (mgr.14385) 98 : cluster [DBG] pgmap v69: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-21T05:02:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:13 smithi110 bash[22020]: cluster 2024-09-21T05:02:12.416213+0000 mgr.y (mgr.14385) 98 : cluster [DBG] pgmap v69: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 1.4 KiB/s wr, 3 op/s 2024-09-21T05:02:15.577 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:15.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:15 smithi089 bash[19831]: cluster 2024-09-21T05:02:14.416855+0000 mgr.y (mgr.14385) 99 : cluster [DBG] pgmap v70: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:02:15.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:15 smithi089 bash[26514]: cluster 2024-09-21T05:02:14.416855+0000 mgr.y (mgr.14385) 99 : cluster [DBG] pgmap v70: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:02:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:15 smithi110 bash[22020]: cluster 2024-09-21T05:02:14.416855+0000 mgr.y (mgr.14385) 99 : cluster [DBG] pgmap v70: 33 pgs: 1 peering, 32 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "c44aa182-fa04-41a7-b40c-7ba43b5e7ca3", 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "z", 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout: "domain_root": "z.rgw.meta:root", 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout: "control_pool": "z.rgw.control", 2024-09-21T05:02:16.734 INFO:teuthology.orchestra.run.smithi089.stdout: "gc_pool": "z.rgw.log:gc", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "lc_pool": "z.rgw.log:lc", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "log_pool": "z.rgw.log", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "roles_pool": "z.rgw.meta:roles", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "otp_pool": "z.rgw.otp", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "notif_pool": "z.rgw.log:notif", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "topics_pool": "z.rgw.meta:topics", 2024-09-21T05:02:16.735 INFO:teuthology.orchestra.run.smithi089.stdout: "account_pool": "z.rgw.meta:accounts", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "group_pool": "z.rgw.meta:groups", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "system_key": { 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "access_key": "", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "secret_key": "" 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "placement_pools": [ 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "default-placement", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "val": { 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "index_pool": "z.rgw.buckets.index", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "storage_classes": { 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "STANDARD": { 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "data_pool": "z.rgw.buckets.data" 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-09-21T05:02:16.736 INFO:teuthology.orchestra.run.smithi089.stdout: "index_type": 0, 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout: "inline_data": true 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout: "realm_id": "1b03e0a8-38fd-49a1-a409-bacc87f26245" 2024-09-21T05:02:16.737 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:02:17.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-09-21T05:02:17.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:17 smithi089 bash[26514]: cluster 2024-09-21T05:02:16.417668+0000 mgr.y (mgr.14385) 100 : cluster [DBG] pgmap v71: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:17.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:17 smithi089 bash[19831]: cluster 2024-09-21T05:02:16.417668+0000 mgr.y (mgr.14385) 100 : cluster [DBG] pgmap v71: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:17.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:17 smithi110 bash[22020]: cluster 2024-09-21T05:02:16.417668+0000 mgr.y (mgr.14385) 100 : cluster [DBG] pgmap v71: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:19 smithi110 bash[22020]: cluster 2024-09-21T05:02:18.418299+0000 mgr.y (mgr.14385) 101 : cluster [DBG] pgmap v72: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:20.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:19 smithi089 bash[19831]: cluster 2024-09-21T05:02:18.418299+0000 mgr.y (mgr.14385) 101 : cluster [DBG] pgmap v72: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:20.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:19 smithi089 bash[26514]: cluster 2024-09-21T05:02:18.418299+0000 mgr.y (mgr.14385) 101 : cluster [DBG] pgmap v72: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:21 smithi110 bash[22020]: cluster 2024-09-21T05:02:20.418923+0000 mgr.y (mgr.14385) 102 : cluster [DBG] pgmap v73: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 310 B/s rd, 413 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:22.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:21 smithi089 bash[19831]: cluster 2024-09-21T05:02:20.418923+0000 mgr.y (mgr.14385) 102 : cluster [DBG] pgmap v73: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 310 B/s rd, 413 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:22.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:21] "GET /metrics HTTP/1.1" 200 28530 "" "Prometheus/2.43.0" 2024-09-21T05:02:22.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:21 smithi089 bash[26514]: cluster 2024-09-21T05:02:20.418923+0000 mgr.y (mgr.14385) 102 : cluster [DBG] pgmap v73: 33 pgs: 33 active+clean; 578 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 310 B/s rd, 413 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T05:02:22.203 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:23 smithi110 bash[22020]: cluster 2024-09-21T05:02:22.419779+0000 mgr.y (mgr.14385) 103 : cluster [DBG] pgmap v74: 33 pgs: 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 469 B/s rd, 469 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:23 smithi089 bash[19831]: cluster 2024-09-21T05:02:22.419779+0000 mgr.y (mgr.14385) 103 : cluster [DBG] pgmap v74: 33 pgs: 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 469 B/s rd, 469 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:23 smithi089 bash[26514]: cluster 2024-09-21T05:02:22.419779+0000 mgr.y (mgr.14385) 103 : cluster [DBG] pgmap v74: 33 pgs: 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 469 B/s rd, 469 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:25.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[19831]: cluster 2024-09-21T05:02:23.858273+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-21T05:02:25.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[19831]: audit 2024-09-21T05:02:23.861739+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-21T05:02:25.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[19831]: cluster 2024-09-21T05:02:24.420390+0000 mgr.y (mgr.14385) 104 : cluster [DBG] pgmap v76: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 511 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:25.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[26514]: cluster 2024-09-21T05:02:23.858273+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-21T05:02:25.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[26514]: audit 2024-09-21T05:02:23.861739+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-21T05:02:25.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:24 smithi089 bash[26514]: cluster 2024-09-21T05:02:24.420390+0000 mgr.y (mgr.14385) 104 : cluster [DBG] pgmap v76: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 511 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:24 smithi110 bash[22020]: cluster 2024-09-21T05:02:23.858273+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-21T05:02:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:24 smithi110 bash[22020]: audit 2024-09-21T05:02:23.861739+0000 mon.a (mon.0) 759 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-09-21T05:02:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:24 smithi110 bash[22020]: cluster 2024-09-21T05:02:24.420390+0000 mgr.y (mgr.14385) 104 : cluster [DBG] pgmap v76: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 242 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 511 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:02:26.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[19831]: cluster 2024-09-21T05:02:24.851950+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:26.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[19831]: audit 2024-09-21T05:02:24.860425+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[19831]: cluster 2024-09-21T05:02:24.871533+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[19831]: audit 2024-09-21T05:02:25.474859+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[19831]: audit 2024-09-21T05:02:25.477109+0000 mon.c (mon.2) 77 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[26514]: cluster 2024-09-21T05:02:24.851950+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[26514]: audit 2024-09-21T05:02:24.860425+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[26514]: cluster 2024-09-21T05:02:24.871533+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[26514]: audit 2024-09-21T05:02:25.474859+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:26.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:25 smithi089 bash[26514]: audit 2024-09-21T05:02:25.477109+0000 mon.c (mon.2) 77 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:25 smithi110 bash[22020]: cluster 2024-09-21T05:02:24.851950+0000 mon.a (mon.0) 760 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:25 smithi110 bash[22020]: audit 2024-09-21T05:02:24.860425+0000 mon.a (mon.0) 761 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-09-21T05:02:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:25 smithi110 bash[22020]: cluster 2024-09-21T05:02:24.871533+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-21T05:02:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:25 smithi110 bash[22020]: audit 2024-09-21T05:02:25.474859+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:25 smithi110 bash[22020]: audit 2024-09-21T05:02:25.477109+0000 mon.c (mon.2) 77 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:27.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[19831]: cluster 2024-09-21T05:02:25.887398+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-21T05:02:27.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[19831]: audit 2024-09-21T05:02:25.894233+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-21T05:02:27.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[19831]: cluster 2024-09-21T05:02:26.421632+0000 mgr.y (mgr.14385) 105 : cluster [DBG] pgmap v79: 97 pgs: 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T05:02:27.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[26514]: cluster 2024-09-21T05:02:25.887398+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-21T05:02:27.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[26514]: audit 2024-09-21T05:02:25.894233+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-21T05:02:27.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:26 smithi089 bash[26514]: cluster 2024-09-21T05:02:26.421632+0000 mgr.y (mgr.14385) 105 : cluster [DBG] pgmap v79: 97 pgs: 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T05:02:27.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:26 smithi110 bash[22020]: cluster 2024-09-21T05:02:25.887398+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-21T05:02:27.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:26 smithi110 bash[22020]: audit 2024-09-21T05:02:25.894233+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-09-21T05:02:27.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:26 smithi110 bash[22020]: cluster 2024-09-21T05:02:26.421632+0000 mgr.y (mgr.14385) 105 : cluster [DBG] pgmap v79: 97 pgs: 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-21T05:02:28.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:27 smithi089 bash[19831]: audit 2024-09-21T05:02:26.885926+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-21T05:02:28.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:27 smithi089 bash[19831]: cluster 2024-09-21T05:02:26.897934+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-21T05:02:28.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:27 smithi089 bash[26514]: audit 2024-09-21T05:02:26.885926+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-21T05:02:28.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:27 smithi089 bash[26514]: cluster 2024-09-21T05:02:26.897934+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-21T05:02:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:27 smithi110 bash[22020]: audit 2024-09-21T05:02:26.885926+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-09-21T05:02:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:27 smithi110 bash[22020]: cluster 2024-09-21T05:02:26.897934+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-21T05:02:29.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: cluster 2024-09-21T05:02:27.898745+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: audit 2024-09-21T05:02:27.902356+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: cluster 2024-09-21T05:02:28.422340+0000 mgr.y (mgr.14385) 106 : cluster [DBG] pgmap v82: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 6 op/s 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: audit 2024-09-21T05:02:28.891996+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: cluster 2024-09-21T05:02:28.900542+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[19831]: audit 2024-09-21T05:02:28.902719+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: cluster 2024-09-21T05:02:27.898745+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: audit 2024-09-21T05:02:27.902356+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: cluster 2024-09-21T05:02:28.422340+0000 mgr.y (mgr.14385) 106 : cluster [DBG] pgmap v82: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 6 op/s 2024-09-21T05:02:29.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: audit 2024-09-21T05:02:28.891996+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-21T05:02:29.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: cluster 2024-09-21T05:02:28.900542+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-21T05:02:29.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:28 smithi089 bash[26514]: audit 2024-09-21T05:02:28.902719+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-21T05:02:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: cluster 2024-09-21T05:02:27.898745+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-21T05:02:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: audit 2024-09-21T05:02:27.902356+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-09-21T05:02:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: cluster 2024-09-21T05:02:28.422340+0000 mgr.y (mgr.14385) 106 : cluster [DBG] pgmap v82: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 6 op/s 2024-09-21T05:02:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: audit 2024-09-21T05:02:28.891996+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-09-21T05:02:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: cluster 2024-09-21T05:02:28.900542+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-21T05:02:29.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:28 smithi110 bash[22020]: audit 2024-09-21T05:02:28.902719+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "7dd25f53-0761-4072-bb4d-863375fd0b09", 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 1, 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout: "predecessor_uuid": "acbf5353-7232-4591-a27c-4cf3a1088a7a", 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout: "sync_status": [], 2024-09-21T05:02:30.016 INFO:teuthology.orchestra.run.smithi089.stdout: "period_map": { 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "7dd25f53-0761-4072-bb4d-863375fd0b09", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "zonegroups": [ 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "59dd792d-3c65-420a-b50f-685906209a8f", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "default", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "api_name": "default", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "is_master": true, 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "endpoints": [], 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "hostnames": [], 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "hostnames_s3website": [], 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "master_zone": "c44aa182-fa04-41a7-b40c-7ba43b5e7ca3", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "zones": [ 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "id": "c44aa182-fa04-41a7-b40c-7ba43b5e7ca3", 2024-09-21T05:02:30.017 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "z", 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "endpoints": [], 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "log_meta": false, 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "log_data": false, 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "bucket_index_max_shards": 11, 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "read_only": false, 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_type": "", 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "sync_from_all": true, 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "sync_from": [], 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "redirect_zone": "", 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "supported_features": [ 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "compress-encrypted", 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "notification_v2", 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: "resharding" 2024-09-21T05:02:30.018 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "placement_targets": [ 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "default-placement", 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "tags": [], 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "storage_classes": [ 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "STANDARD" 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "default_placement": "default-placement", 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "realm_id": "1b03e0a8-38fd-49a1-a409-bacc87f26245", 2024-09-21T05:02:30.019 INFO:teuthology.orchestra.run.smithi089.stdout: "sync_policy": { 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "groups": [] 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled_features": [ 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "notification_v2", 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "resharding" 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "short_zone_ids": [ 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "c44aa182-fa04-41a7-b40c-7ba43b5e7ca3", 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: "val": 706193516 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:30.020 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "master_zonegroup": "59dd792d-3c65-420a-b50f-685906209a8f", 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "master_zone": "c44aa182-fa04-41a7-b40c-7ba43b5e7ca3", 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "period_config": { 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "bucket_quota": { 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": false, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "check_on_raw": false, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "max_size": -1, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "max_size_kb": 0, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "max_objects": -1 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "user_quota": { 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": false, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "check_on_raw": false, 2024-09-21T05:02:30.021 INFO:teuthology.orchestra.run.smithi089.stdout: "max_size": -1, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_size_kb": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_objects": -1 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "user_ratelimit": { 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_ops": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_ops": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_bytes": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_bytes": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": false 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "bucket_ratelimit": { 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_ops": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_ops": 0, 2024-09-21T05:02:30.022 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_bytes": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_bytes": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": false 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "anonymous_ratelimit": { 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_ops": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_ops": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "max_read_bytes": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "max_write_bytes": 0, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "enabled": false 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "realm_id": "1b03e0a8-38fd-49a1-a409-bacc87f26245", 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout: "realm_epoch": 2 2024-09-21T05:02:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:02:30.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-09-21T05:02:31.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[19831]: audit 2024-09-21T05:02:29.894510+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T05:02:31.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[19831]: cluster 2024-09-21T05:02:29.901703+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-21T05:02:31.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[19831]: cluster 2024-09-21T05:02:30.423046+0000 mgr.y (mgr.14385) 107 : cluster [DBG] pgmap v85: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[26514]: audit 2024-09-21T05:02:29.894510+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T05:02:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[26514]: cluster 2024-09-21T05:02:29.901703+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-21T05:02:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:30 smithi089 bash[26514]: cluster 2024-09-21T05:02:30.423046+0000 mgr.y (mgr.14385) 107 : cluster [DBG] pgmap v85: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:30 smithi110 bash[22020]: audit 2024-09-21T05:02:29.894510+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.89:0/1110573675' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-21T05:02:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:30 smithi110 bash[22020]: cluster 2024-09-21T05:02:29.901703+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-21T05:02:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:30 smithi110 bash[22020]: cluster 2024-09-21T05:02:30.423046+0000 mgr.y (mgr.14385) 107 : cluster [DBG] pgmap v85: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 579 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:32.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:31 smithi089 bash[19831]: cluster 2024-09-21T05:02:30.894466+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:32.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:31 smithi089 bash[19831]: cluster 2024-09-21T05:02:30.894515+0000 mon.a (mon.0) 776 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:32.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:31] "GET /metrics HTTP/1.1" 200 30907 "" "Prometheus/2.43.0" 2024-09-21T05:02:32.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:31 smithi089 bash[26514]: cluster 2024-09-21T05:02:30.894466+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:32.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:31 smithi089 bash[26514]: cluster 2024-09-21T05:02:30.894515+0000 mon.a (mon.0) 776 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:31 smithi110 bash[22020]: cluster 2024-09-21T05:02:30.894466+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:31 smithi110 bash[22020]: cluster 2024-09-21T05:02:30.894515+0000 mon.a (mon.0) 776 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:33.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:32 smithi089 bash[19831]: cluster 2024-09-21T05:02:32.424445+0000 mgr.y (mgr.14385) 108 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:02:33.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:32 smithi089 bash[26514]: cluster 2024-09-21T05:02:32.424445+0000 mgr.y (mgr.14385) 108 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:02:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:32 smithi110 bash[22020]: cluster 2024-09-21T05:02:32.424445+0000 mgr.y (mgr.14385) 108 : cluster [DBG] pgmap v86: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T05:02:35.507 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:35.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:35 smithi089 bash[19831]: cluster 2024-09-21T05:02:34.425110+0000 mgr.y (mgr.14385) 109 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T05:02:35.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:35 smithi089 bash[26514]: cluster 2024-09-21T05:02:34.425110+0000 mgr.y (mgr.14385) 109 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T05:02:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:35 smithi110 bash[22020]: cluster 2024-09-21T05:02:34.425110+0000 mgr.y (mgr.14385) 109 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-21T05:02:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled rgw.foo update... 2024-09-21T05:02:37.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph osd pool create foo' 2024-09-21T05:02:37.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:37 smithi089 bash[19831]: cluster 2024-09-21T05:02:36.426516+0000 mgr.y (mgr.14385) 110 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T05:02:37.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:37 smithi089 bash[19831]: audit 2024-09-21T05:02:36.974234+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:37.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:37 smithi089 bash[26514]: cluster 2024-09-21T05:02:36.426516+0000 mgr.y (mgr.14385) 110 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T05:02:37.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:37 smithi089 bash[26514]: audit 2024-09-21T05:02:36.974234+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:37 smithi110 bash[22020]: cluster 2024-09-21T05:02:36.426516+0000 mgr.y (mgr.14385) 110 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-09-21T05:02:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:37 smithi110 bash[22020]: audit 2024-09-21T05:02:36.974234+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:36.962488+0000 mgr.y (mgr.14385) 111 : audit [DBG] from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: cephadm 2024-09-21T05:02:36.966224+0000 mgr.y (mgr.14385) 112 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.571338+0000 mon.c (mon.2) 78 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.572257+0000 mon.c (mon.2) 79 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.580529+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.591557+0000 mon.c (mon.2) 80 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.592215+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.596930+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.610912+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: audit 2024-09-21T05:02:37.616527+0000 mon.c (mon.2) 81 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[19831]: cephadm 2024-09-21T05:02:37.618123+0000 mgr.y (mgr.14385) 113 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:36.962488+0000 mgr.y (mgr.14385) 111 : audit [DBG] from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: cephadm 2024-09-21T05:02:36.966224+0000 mgr.y (mgr.14385) 112 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.571338+0000 mon.c (mon.2) 78 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.572257+0000 mon.c (mon.2) 79 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.580529+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.591557+0000 mon.c (mon.2) 80 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.592215+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.596930+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:38.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.610912+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: audit 2024-09-21T05:02:37.616527+0000 mon.c (mon.2) 81 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:38 smithi089 bash[26514]: cephadm 2024-09-21T05:02:37.618123+0000 mgr.y (mgr.14385) 113 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:02:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:36.962488+0000 mgr.y (mgr.14385) 111 : audit [DBG] from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:02:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: cephadm 2024-09-21T05:02:36.966224+0000 mgr.y (mgr.14385) 112 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.571338+0000 mon.c (mon.2) 78 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.572257+0000 mon.c (mon.2) 79 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.580529+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.591557+0000 mon.c (mon.2) 80 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.592215+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.596930+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.610912+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: audit 2024-09-21T05:02:37.616527+0000 mon.c (mon.2) 81 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:38.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:38 smithi110 bash[22020]: cephadm 2024-09-21T05:02:37.618123+0000 mgr.y (mgr.14385) 113 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:02:40.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:39 smithi089 bash[19831]: cluster 2024-09-21T05:02:38.427185+0000 mgr.y (mgr.14385) 114 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T05:02:40.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:39 smithi089 bash[26514]: cluster 2024-09-21T05:02:38.427185+0000 mgr.y (mgr.14385) 114 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T05:02:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:39 smithi110 bash[22020]: cluster 2024-09-21T05:02:38.427185+0000 mgr.y (mgr.14385) 114 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-21T05:02:40.384 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.384 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.384 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.385 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.385 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.385 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.385 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.386 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.386 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.648 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.649 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.650 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.650 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.651 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.654 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.656 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.656 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:40.656 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:02:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: cluster 2024-09-21T05:02:40.427739+0000 mgr.y (mgr.14385) 115 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.473704+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.476247+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.701726+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.715080+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.725815+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.728232+0000 mon.c (mon.2) 83 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.728886+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.732270+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:41.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.745037+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[19831]: audit 2024-09-21T05:02:40.750312+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: cluster 2024-09-21T05:02:40.427739+0000 mgr.y (mgr.14385) 115 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.473704+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.476247+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.701726+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.715080+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.725815+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.728232+0000 mon.c (mon.2) 83 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.728886+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.732270+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:41.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.745037+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[26514]: audit 2024-09-21T05:02:40.750312+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: cluster 2024-09-21T05:02:40.427739+0000 mgr.y (mgr.14385) 115 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.473704+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.476247+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.701726+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.715080+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.725815+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.728232+0000 mon.c (mon.2) 83 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.728886+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-21T05:02:41.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.732270+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-21T05:02:41.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.745037+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:41.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:41 smithi110 bash[22020]: audit 2024-09-21T05:02:40.750312+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:42.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:41] "GET /metrics HTTP/1.1" 200 35515 "" "Prometheus/2.43.0" 2024-09-21T05:02:42.395 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:42.729 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:42 smithi089 bash[26514]: cephadm 2024-09-21T05:02:40.752454+0000 mgr.y (mgr.14385) 116 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:02:42.729 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:42 smithi089 bash[19831]: cephadm 2024-09-21T05:02:40.752454+0000 mgr.y (mgr.14385) 116 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:02:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:42 smithi110 bash[22020]: cephadm 2024-09-21T05:02:40.752454+0000 mgr.y (mgr.14385) 116 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:02:43.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:43 smithi089 bash[19831]: cluster 2024-09-21T05:02:42.428755+0000 mgr.y (mgr.14385) 117 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T05:02:43.561 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:43 smithi089 bash[26514]: cluster 2024-09-21T05:02:42.428755+0000 mgr.y (mgr.14385) 117 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T05:02:43.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:43 smithi110 bash[22020]: cluster 2024-09-21T05:02:42.428755+0000 mgr.y (mgr.14385) 117 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T05:02:44.752 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.752 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.752 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.753 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.753 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.753 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.753 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.754 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:44.754 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.046 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.047 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.047 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:44 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: cluster 2024-09-21T05:02:44.429416+0000 mgr.y (mgr.14385) 118 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.043597+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.049775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.055775+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.060696+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.068043+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.075216+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[19831]: audit 2024-09-21T05:02:45.079197+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: cluster 2024-09-21T05:02:44.429416+0000 mgr.y (mgr.14385) 118 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:45.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.043597+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.049775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.055775+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.060696+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.068043+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.075216+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:45 smithi089 bash[26514]: audit 2024-09-21T05:02:45.079197+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: cluster 2024-09-21T05:02:44.429416+0000 mgr.y (mgr.14385) 118 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 581 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:02:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.043597+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.049775+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.055775+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.060696+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.068043+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.075216+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:45.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:45 smithi110 bash[22020]: audit 2024-09-21T05:02:45.079197+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:46.079 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'foo' created 2024-09-21T05:02:46.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'rbd pool init foo' 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[19831]: cephadm 2024-09-21T05:02:45.069879+0000 mgr.y (mgr.14385) 119 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[19831]: audit 2024-09-21T05:02:45.091724+0000 mon.a (mon.0) 796 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[19831]: audit 2024-09-21T05:02:45.521129+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[19831]: audit 2024-09-21T05:02:46.080887+0000 mon.a (mon.0) 798 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[19831]: cluster 2024-09-21T05:02:46.087558+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[26514]: cephadm 2024-09-21T05:02:45.069879+0000 mgr.y (mgr.14385) 119 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:46.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[26514]: audit 2024-09-21T05:02:45.091724+0000 mon.a (mon.0) 796 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-21T05:02:46.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[26514]: audit 2024-09-21T05:02:45.521129+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:46.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[26514]: audit 2024-09-21T05:02:46.080887+0000 mon.a (mon.0) 798 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-21T05:02:46.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:46 smithi089 bash[26514]: cluster 2024-09-21T05:02:46.087558+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-21T05:02:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:46 smithi110 bash[22020]: cephadm 2024-09-21T05:02:45.069879+0000 mgr.y (mgr.14385) 119 : cephadm [INF] Saving service rgw.foo spec with placement count:2 2024-09-21T05:02:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:46 smithi110 bash[22020]: audit 2024-09-21T05:02:45.091724+0000 mon.a (mon.0) 796 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-09-21T05:02:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:46 smithi110 bash[22020]: audit 2024-09-21T05:02:45.521129+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:46 smithi110 bash[22020]: audit 2024-09-21T05:02:46.080887+0000 mon.a (mon.0) 798 : audit [INF] from='client.? 172.21.15.89:0/3368104737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-09-21T05:02:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:46 smithi110 bash[22020]: cluster 2024-09-21T05:02:46.087558+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-21T05:02:47.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[19831]: cluster 2024-09-21T05:02:46.430160+0000 mgr.y (mgr.14385) 120 : cluster [DBG] pgmap v94: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-21T05:02:47.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[19831]: cluster 2024-09-21T05:02:47.080850+0000 mon.a (mon.0) 800 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:47.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[19831]: cluster 2024-09-21T05:02:47.095822+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-21T05:02:47.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[26514]: cluster 2024-09-21T05:02:46.430160+0000 mgr.y (mgr.14385) 120 : cluster [DBG] pgmap v94: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-21T05:02:47.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[26514]: cluster 2024-09-21T05:02:47.080850+0000 mon.a (mon.0) 800 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:47.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:47 smithi089 bash[26514]: cluster 2024-09-21T05:02:47.095822+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-21T05:02:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:47 smithi110 bash[22020]: cluster 2024-09-21T05:02:46.430160+0000 mgr.y (mgr.14385) 120 : cluster [DBG] pgmap v94: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 3.3 KiB/s wr, 161 op/s 2024-09-21T05:02:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:47 smithi110 bash[22020]: cluster 2024-09-21T05:02:47.080850+0000 mon.a (mon.0) 800 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-21T05:02:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:47 smithi110 bash[22020]: cluster 2024-09-21T05:02:47.095822+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-21T05:02:49.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:49 smithi089 bash[19831]: cluster 2024-09-21T05:02:48.101555+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-21T05:02:49.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:49 smithi089 bash[19831]: cluster 2024-09-21T05:02:48.430903+0000 mgr.y (mgr.14385) 121 : cluster [DBG] pgmap v97: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:49.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:49 smithi089 bash[26514]: cluster 2024-09-21T05:02:48.101555+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-21T05:02:49.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:49 smithi089 bash[26514]: cluster 2024-09-21T05:02:48.430903+0000 mgr.y (mgr.14385) 121 : cluster [DBG] pgmap v97: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:49 smithi110 bash[22020]: cluster 2024-09-21T05:02:48.101555+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-09-21T05:02:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:49 smithi110 bash[22020]: cluster 2024-09-21T05:02:48.430903+0000 mgr.y (mgr.14385) 121 : cluster [DBG] pgmap v97: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:51.277 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[19831]: cluster 2024-09-21T05:02:50.431670+0000 mgr.y (mgr.14385) 122 : cluster [DBG] pgmap v98: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[19831]: audit 2024-09-21T05:02:50.923111+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[19831]: audit 2024-09-21T05:02:50.938248+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[26514]: cluster 2024-09-21T05:02:50.431670+0000 mgr.y (mgr.14385) 122 : cluster [DBG] pgmap v98: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[26514]: audit 2024-09-21T05:02:50.923111+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:51.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[26514]: audit 2024-09-21T05:02:50.938248+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:51 smithi110 bash[22020]: cluster 2024-09-21T05:02:50.431670+0000 mgr.y (mgr.14385) 122 : cluster [DBG] pgmap v98: 161 pgs: 32 creating+peering, 129 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s rd, 5.5 KiB/s wr, 269 op/s 2024-09-21T05:02:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:51 smithi110 bash[22020]: audit 2024-09-21T05:02:50.923111+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:51 smithi110 bash[22020]: audit 2024-09-21T05:02:50.938248+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.281 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:02:51] "GET /metrics HTTP/1.1" 200 35515 "" "Prometheus/2.43.0" 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STOPPING 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STOPPED 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STARTING 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Serving on http://:::9283 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STARTED 2024-09-21T05:02:52.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STOPPING 2024-09-21T05:02:52.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:51.844746+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:51.850331+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:51.851705+0000 mon.c (mon.2) 85 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:52.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:51.852454+0000 mon.c (mon.2) 86 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:52.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: cephadm 2024-09-21T05:02:51.856701+0000 mgr.y (mgr.14385) 123 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.278791+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.287561+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.295409+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.379731+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.380553+0000 mon.c (mon.2) 88 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: cephadm 2024-09-21T05:02:52.383842+0000 mgr.y (mgr.14385) 124 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: cluster 2024-09-21T05:02:52.432760+0000 mgr.y (mgr.14385) 125 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 5.4 KiB/s wr, 486 op/s 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.640031+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.719863+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.89:0/623519575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[19831]: audit 2024-09-21T05:02:52.720140+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:51.844746+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:51.850331+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:51.851705+0000 mon.c (mon.2) 85 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:51.852454+0000 mon.c (mon.2) 86 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: cephadm 2024-09-21T05:02:51.856701+0000 mgr.y (mgr.14385) 123 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.278791+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.287561+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.295409+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.379731+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.380553+0000 mon.c (mon.2) 88 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: cephadm 2024-09-21T05:02:52.383842+0000 mgr.y (mgr.14385) 124 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: cluster 2024-09-21T05:02:52.432760+0000 mgr.y (mgr.14385) 125 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 5.4 KiB/s wr, 486 op/s 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.640031+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.719863+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.89:0/623519575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:52.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[26514]: audit 2024-09-21T05:02:52.720140+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:53.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:02:53.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STOPPED 2024-09-21T05:02:53.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:52 smithi089 bash[20084]: [21/Sep/2024:05:02:52] ENGINE Bus STARTING 2024-09-21T05:02:53.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:53 smithi089 bash[20084]: [21/Sep/2024:05:02:53] ENGINE Serving on http://:::9283 2024-09-21T05:02:53.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:02:53 smithi089 bash[20084]: [21/Sep/2024:05:02:53] ENGINE Bus STARTED 2024-09-21T05:02:53.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:51.844746+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:51.850331+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:51.851705+0000 mon.c (mon.2) 85 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:51.852454+0000 mon.c (mon.2) 86 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: cephadm 2024-09-21T05:02:51.856701+0000 mgr.y (mgr.14385) 123 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.278791+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.287561+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.295409+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.379731+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:02:53.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.380553+0000 mon.c (mon.2) 88 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:02:53.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: cephadm 2024-09-21T05:02:52.383842+0000 mgr.y (mgr.14385) 124 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:02:53.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: cluster 2024-09-21T05:02:52.432760+0000 mgr.y (mgr.14385) 125 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 263 KiB/s rd, 5.4 KiB/s wr, 486 op/s 2024-09-21T05:02:53.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.640031+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:02:53.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.719863+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.89:0/623519575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:53.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:52 smithi110 bash[22020]: audit 2024-09-21T05:02:52.720140+0000 mon.a (mon.0) 811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-09-21T05:02:55.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:54 smithi089 bash[26514]: audit 2024-09-21T05:02:53.642620+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-21T05:02:55.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:54 smithi089 bash[26514]: cluster 2024-09-21T05:02:53.652677+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-21T05:02:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:54 smithi089 bash[19831]: audit 2024-09-21T05:02:53.642620+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-21T05:02:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:54 smithi089 bash[19831]: cluster 2024-09-21T05:02:53.652677+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-21T05:02:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:54 smithi110 bash[22020]: audit 2024-09-21T05:02:53.642620+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-09-21T05:02:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:54 smithi110 bash[22020]: cluster 2024-09-21T05:02:53.652677+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-09-21T05:02:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[19831]: cluster 2024-09-21T05:02:54.433533+0000 mgr.y (mgr.14385) 126 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s rd, 139 B/s wr, 200 op/s 2024-09-21T05:02:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[19831]: cluster 2024-09-21T05:02:54.642570+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[19831]: cluster 2024-09-21T05:02:54.642624+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[19831]: cluster 2024-09-21T05:02:54.662713+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[19831]: audit 2024-09-21T05:02:55.468032+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[26514]: cluster 2024-09-21T05:02:54.433533+0000 mgr.y (mgr.14385) 126 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s rd, 139 B/s wr, 200 op/s 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[26514]: cluster 2024-09-21T05:02:54.642570+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[26514]: cluster 2024-09-21T05:02:54.642624+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[26514]: cluster 2024-09-21T05:02:54.662713+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-21T05:02:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:55 smithi089 bash[26514]: audit 2024-09-21T05:02:55.468032+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:55 smithi110 bash[22020]: cluster 2024-09-21T05:02:54.433533+0000 mgr.y (mgr.14385) 126 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 248 MiB used, 715 GiB / 715 GiB avail; 126 KiB/s rd, 139 B/s wr, 200 op/s 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:55 smithi110 bash[22020]: cluster 2024-09-21T05:02:54.642570+0000 mon.a (mon.0) 814 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:55 smithi110 bash[22020]: cluster 2024-09-21T05:02:54.642624+0000 mon.a (mon.0) 815 : cluster [INF] Cluster is now healthy 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:55 smithi110 bash[22020]: cluster 2024-09-21T05:02:54.662713+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-09-21T05:02:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:55 smithi110 bash[22020]: audit 2024-09-21T05:02:55.468032+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:02:56.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch apply iscsi foo u p' 2024-09-21T05:02:56.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:56 smithi089 bash[19831]: cluster 2024-09-21T05:02:55.664764+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-21T05:02:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:56 smithi089 bash[19831]: cluster 2024-09-21T05:02:56.435265+0000 mgr.y (mgr.14385) 127 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 852 B/s wr, 256 op/s 2024-09-21T05:02:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:56 smithi089 bash[26514]: cluster 2024-09-21T05:02:55.664764+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-21T05:02:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:56 smithi089 bash[26514]: cluster 2024-09-21T05:02:56.435265+0000 mgr.y (mgr.14385) 127 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 852 B/s wr, 256 op/s 2024-09-21T05:02:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:56 smithi110 bash[22020]: cluster 2024-09-21T05:02:55.664764+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-09-21T05:02:57.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:56 smithi110 bash[22020]: cluster 2024-09-21T05:02:56.435265+0000 mgr.y (mgr.14385) 127 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 852 B/s wr, 256 op/s 2024-09-21T05:02:58.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:57 smithi089 bash[26514]: cluster 2024-09-21T05:02:56.873323+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-21T05:02:58.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:57 smithi089 bash[19831]: cluster 2024-09-21T05:02:56.873323+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-21T05:02:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:57 smithi110 bash[22020]: cluster 2024-09-21T05:02:56.873323+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-09-21T05:02:59.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:02:58 smithi089 bash[19831]: cluster 2024-09-21T05:02:58.436023+0000 mgr.y (mgr.14385) 128 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 855 B/s wr, 14 op/s 2024-09-21T05:02:59.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:02:58 smithi089 bash[26514]: cluster 2024-09-21T05:02:58.436023+0000 mgr.y (mgr.14385) 128 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 855 B/s wr, 14 op/s 2024-09-21T05:02:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:02:58 smithi110 bash[22020]: cluster 2024-09-21T05:02:58.436023+0000 mgr.y (mgr.14385) 128 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 855 B/s wr, 14 op/s 2024-09-21T05:03:01.255 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:03:01.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:01 smithi089 bash[19831]: cluster 2024-09-21T05:03:00.436765+0000 mgr.y (mgr.14385) 129 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:03:01.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:01 smithi089 bash[26514]: cluster 2024-09-21T05:03:00.436765+0000 mgr.y (mgr.14385) 129 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:03:01.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:01 smithi110 bash[22020]: cluster 2024-09-21T05:03:00.436765+0000 mgr.y (mgr.14385) 129 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T05:03:02.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:01] "GET /metrics HTTP/1.1" 200 38093 "" "Prometheus/2.43.0" 2024-09-21T05:03:02.812 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled iscsi.foo update... 2024-09-21T05:03:03.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:03:03.594 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: cluster 2024-09-21T05:03:02.438450+0000 mgr.y (mgr.14385) 130 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 9.1 KiB/s rd, 526 B/s wr, 8 op/s 2024-09-21T05:03:03.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.810580+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.816193+0000 mon.c (mon.2) 91 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:03.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.817393+0000 mon.c (mon.2) 92 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.824120+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.830130+0000 mon.c (mon.2) 93 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.830557+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.834734+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[26514]: audit 2024-09-21T05:03:02.843100+0000 mon.c (mon.2) 94 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: cluster 2024-09-21T05:03:02.438450+0000 mgr.y (mgr.14385) 130 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 9.1 KiB/s rd, 526 B/s wr, 8 op/s 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.810580+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.816193+0000 mon.c (mon.2) 91 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.817393+0000 mon.c (mon.2) 92 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.824120+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.830130+0000 mon.c (mon.2) 93 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.830557+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.834734+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T05:03:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:03 smithi089 bash[19831]: audit 2024-09-21T05:03:02.843100+0000 mon.c (mon.2) 94 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: cluster 2024-09-21T05:03:02.438450+0000 mgr.y (mgr.14385) 130 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 9.1 KiB/s rd, 526 B/s wr, 8 op/s 2024-09-21T05:03:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.810580+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.816193+0000 mon.c (mon.2) 91 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.817393+0000 mon.c (mon.2) 92 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.824120+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.830130+0000 mon.c (mon.2) 93 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.830557+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:03:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.834734+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-21T05:03:03.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:03 smithi110 bash[22020]: audit 2024-09-21T05:03:02.843100+0000 mon.c (mon.2) 94 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:04.772 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[19831]: audit 2024-09-21T05:03:02.804152+0000 mgr.y (mgr.14385) 131 : audit [DBG] from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:04.773 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[19831]: cephadm 2024-09-21T05:03:02.805795+0000 mgr.y (mgr.14385) 132 : cephadm [INF] Saving service iscsi.foo spec with placement count:1 2024-09-21T05:03:04.773 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[19831]: cephadm 2024-09-21T05:03:02.844146+0000 mgr.y (mgr.14385) 133 : cephadm [INF] Deploying daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:03:04.773 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[26514]: audit 2024-09-21T05:03:02.804152+0000 mgr.y (mgr.14385) 131 : audit [DBG] from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:04.773 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[26514]: cephadm 2024-09-21T05:03:02.805795+0000 mgr.y (mgr.14385) 132 : cephadm [INF] Saving service iscsi.foo spec with placement count:1 2024-09-21T05:03:04.773 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:04 smithi089 bash[26514]: cephadm 2024-09-21T05:03:02.844146+0000 mgr.y (mgr.14385) 133 : cephadm [INF] Deploying daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:03:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:04 smithi110 bash[22020]: audit 2024-09-21T05:03:02.804152+0000 mgr.y (mgr.14385) 131 : audit [DBG] from='client.14793 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:03:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:04 smithi110 bash[22020]: cephadm 2024-09-21T05:03:02.805795+0000 mgr.y (mgr.14385) 132 : cephadm [INF] Saving service iscsi.foo spec with placement count:1 2024-09-21T05:03:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:04 smithi110 bash[22020]: cephadm 2024-09-21T05:03:02.844146+0000 mgr.y (mgr.14385) 133 : cephadm [INF] Deploying daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:03:05.632 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:05 smithi089 bash[19831]: cluster 2024-09-21T05:03:04.439175+0000 mgr.y (mgr.14385) 134 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 466 B/s wr, 7 op/s 2024-09-21T05:03:05.632 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.632 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.633 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.633 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.633 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.633 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.634 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.634 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.634 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:05 smithi089 bash[26514]: cluster 2024-09-21T05:03:04.439175+0000 mgr.y (mgr.14385) 134 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 466 B/s wr, 7 op/s 2024-09-21T05:03:05.634 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:05 smithi110 bash[22020]: cluster 2024-09-21T05:03:04.439175+0000 mgr.y (mgr.14385) 134 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 466 B/s wr, 7 op/s 2024-09-21T05:03:05.901 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.901 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.901 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.902 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.902 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.902 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.902 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.903 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:05.903 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:03:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:03:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: audit 2024-09-21T05:03:05.955455+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: audit 2024-09-21T05:03:05.961424+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: audit 2024-09-21T05:03:05.966450+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: cephadm 2024-09-21T05:03:05.967256+0000 mgr.y (mgr.14385) 135 : cephadm [INF] Checking pool "foo" exists for service iscsi.foo 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: audit 2024-09-21T05:03:05.977235+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[19831]: cluster 2024-09-21T05:03:06.440679+0000 mgr.y (mgr.14385) 136 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: audit 2024-09-21T05:03:05.955455+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: audit 2024-09-21T05:03:05.961424+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: audit 2024-09-21T05:03:05.966450+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: cephadm 2024-09-21T05:03:05.967256+0000 mgr.y (mgr.14385) 135 : cephadm [INF] Checking pool "foo" exists for service iscsi.foo 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: audit 2024-09-21T05:03:05.977235+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:06 smithi089 bash[26514]: cluster 2024-09-21T05:03:06.440679+0000 mgr.y (mgr.14385) 136 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: audit 2024-09-21T05:03:05.955455+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: audit 2024-09-21T05:03:05.961424+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: audit 2024-09-21T05:03:05.966450+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: cephadm 2024-09-21T05:03:05.967256+0000 mgr.y (mgr.14385) 135 : cephadm [INF] Checking pool "foo" exists for service iscsi.foo 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: audit 2024-09-21T05:03:05.977235+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:06 smithi110 bash[22020]: cluster 2024-09-21T05:03:06.440679+0000 mgr.y (mgr.14385) 136 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:08.185 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:09 smithi089 bash[19831]: cluster 2024-09-21T05:03:07.990696+0000 mon.a (mon.0) 827 : cluster [DBG] mgrmap e21: y(active, since 2m), standbys: x 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:09 smithi089 bash[19831]: audit 2024-09-21T05:03:08.095576+0000 mon.c (mon.2) 95 : audit [DBG] from='client.? 172.21.15.89:0/824535298' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:09 smithi089 bash[19831]: audit 2024-09-21T05:03:08.406022+0000 mon.a (mon.0) 828 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]: dispatch 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:09 smithi089 bash[19831]: cluster 2024-09-21T05:03:08.441295+0000 mgr.y (mgr.14385) 137 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:08 smithi089 bash[26514]: cluster 2024-09-21T05:03:07.990696+0000 mon.a (mon.0) 827 : cluster [DBG] mgrmap e21: y(active, since 2m), standbys: x 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:08 smithi089 bash[26514]: audit 2024-09-21T05:03:08.095576+0000 mon.c (mon.2) 95 : audit [DBG] from='client.? 172.21.15.89:0/824535298' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:08 smithi089 bash[26514]: audit 2024-09-21T05:03:08.406022+0000 mon.a (mon.0) 828 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]: dispatch 2024-09-21T05:03:09.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:08 smithi089 bash[26514]: cluster 2024-09-21T05:03:08.441295+0000 mgr.y (mgr.14385) 137 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:08 smithi110 bash[22020]: cluster 2024-09-21T05:03:07.990696+0000 mon.a (mon.0) 827 : cluster [DBG] mgrmap e21: y(active, since 2m), standbys: x 2024-09-21T05:03:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:08 smithi110 bash[22020]: audit 2024-09-21T05:03:08.095576+0000 mon.c (mon.2) 95 : audit [DBG] from='client.? 172.21.15.89:0/824535298' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:03:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:08 smithi110 bash[22020]: audit 2024-09-21T05:03:08.406022+0000 mon.a (mon.0) 828 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]: dispatch 2024-09-21T05:03:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:08 smithi110 bash[22020]: cluster 2024-09-21T05:03:08.441295+0000 mgr.y (mgr.14385) 137 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:10.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[19831]: audit 2024-09-21T05:03:08.994225+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]': finished 2024-09-21T05:03:10.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[19831]: cluster 2024-09-21T05:03:09.010497+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-21T05:03:10.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[19831]: audit 2024-09-21T05:03:09.319519+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]: dispatch 2024-09-21T05:03:10.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[26514]: audit 2024-09-21T05:03:08.994225+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]': finished 2024-09-21T05:03:10.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[26514]: cluster 2024-09-21T05:03:09.010497+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-21T05:03:10.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:10 smithi089 bash[26514]: audit 2024-09-21T05:03:09.319519+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]: dispatch 2024-09-21T05:03:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:10 smithi110 bash[22020]: audit 2024-09-21T05:03:08.994225+0000 mon.a (mon.0) 829 : audit [INF] from='client.? 172.21.15.89:0/907321783' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2004572141"}]': finished 2024-09-21T05:03:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:10 smithi110 bash[22020]: cluster 2024-09-21T05:03:09.010497+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-09-21T05:03:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:10 smithi110 bash[22020]: audit 2024-09-21T05:03:09.319519+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]: dispatch 2024-09-21T05:03:11.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:09.996746+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]': finished 2024-09-21T05:03:11.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: cluster 2024-09-21T05:03:10.005995+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-21T05:03:11.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.310933+0000 mon.a (mon.0) 834 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]: dispatch 2024-09-21T05:03:11.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: cluster 2024-09-21T05:03:10.441987+0000 mgr.y (mgr.14385) 138 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:11.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.503620+0000 mon.c (mon.2) 96 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.559480+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.571838+0000 mon.c (mon.2) 97 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.572337+0000 mon.c (mon.2) 98 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.572815+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.573069+0000 mon.c (mon.2) 99 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.573890+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[19831]: audit 2024-09-21T05:03:10.574451+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:09.996746+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]': finished 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: cluster 2024-09-21T05:03:10.005995+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.310933+0000 mon.a (mon.0) 834 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]: dispatch 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: cluster 2024-09-21T05:03:10.441987+0000 mgr.y (mgr.14385) 138 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:11.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.503620+0000 mon.c (mon.2) 96 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.559480+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.571838+0000 mon.c (mon.2) 97 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.572337+0000 mon.c (mon.2) 98 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.572815+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.573069+0000 mon.c (mon.2) 99 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.573890+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[26514]: audit 2024-09-21T05:03:10.574451+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:09.996746+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.89:0/1733715514' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1370258133"}]': finished 2024-09-21T05:03:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: cluster 2024-09-21T05:03:10.005995+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-09-21T05:03:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.310933+0000 mon.a (mon.0) 834 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: cluster 2024-09-21T05:03:10.441987+0000 mgr.y (mgr.14385) 138 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.503620+0000 mon.c (mon.2) 96 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.559480+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.571838+0000 mon.c (mon.2) 97 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.572337+0000 mon.c (mon.2) 98 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.572815+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.573069+0000 mon.c (mon.2) 99 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.573890+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-09-21T05:03:11.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:11 smithi110 bash[22020]: audit 2024-09-21T05:03:10.574451+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-09-21T05:03:12.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:11] "GET /metrics HTTP/1.1" 200 38150 "" "Prometheus/2.43.0" 2024-09-21T05:03:12.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:11 smithi089 bash[20084]: [21/Sep/2024:05:03:11] ENGINE Bus STOPPING 2024-09-21T05:03:12.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.019890+0000 mon.a (mon.0) 839 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]': finished 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.020046+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.020287+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]': finished 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.020473+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: cluster 2024-09-21T05:03:11.027104+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.354885+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.89:0/2748551874' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.355344+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.874824+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.900015+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.901647+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.902331+0000 mon.c (mon.2) 102 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.909206+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.972263+0000 mon.c (mon.2) 103 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.975174+0000 mon.c (mon.2) 104 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.985072+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:11.999226+0000 mon.c (mon.2) 105 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[19831]: audit 2024-09-21T05:03:12.008999+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.019890+0000 mon.a (mon.0) 839 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]': finished 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.020046+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.020287+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]': finished 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.020473+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: cluster 2024-09-21T05:03:11.027104+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.354885+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.89:0/2748551874' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.355344+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.874824+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.900015+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.901647+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.902331+0000 mon.c (mon.2) 102 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.909206+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.972263+0000 mon.c (mon.2) 103 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.975174+0000 mon.c (mon.2) 104 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.985072+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:11.999226+0000 mon.c (mon.2) 105 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:12.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[26514]: audit 2024-09-21T05:03:12.008999+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.019890+0000 mon.a (mon.0) 839 : audit [INF] from='client.? 172.21.15.89:0/3619855049' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3989638145"}]': finished 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.020046+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]': finished 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.020287+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]': finished 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.020473+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: cluster 2024-09-21T05:03:11.027104+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.354885+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.89:0/2748551874' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.355344+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]: dispatch 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.874824+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.900015+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.901647+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:12.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.902331+0000 mon.c (mon.2) 102 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.909206+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.972263+0000 mon.c (mon.2) 103 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.975174+0000 mon.c (mon.2) 104 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.985072+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:11.999226+0000 mon.c (mon.2) 105 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:12.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:12 smithi110 bash[22020]: audit 2024-09-21T05:03:12.008999+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:12.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[20084]: [21/Sep/2024:05:03:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:03:12.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[20084]: [21/Sep/2024:05:03:12] ENGINE Bus STOPPED 2024-09-21T05:03:12.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[20084]: [21/Sep/2024:05:03:12] ENGINE Bus STARTING 2024-09-21T05:03:12.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[20084]: [21/Sep/2024:05:03:12] ENGINE Serving on http://:::9283 2024-09-21T05:03:12.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:12 smithi089 bash[20084]: [21/Sep/2024:05:03:12] ENGINE Bus STARTED 2024-09-21T05:03:13.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:11.973514+0000 mgr.y (mgr.14385) 139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:13.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: cephadm 2024-09-21T05:03:11.974786+0000 mgr.y (mgr.14385) 140 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:11.976031+0000 mgr.y (mgr.14385) 141 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:11.999892+0000 mgr.y (mgr.14385) 142 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:12.022356+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]': finished 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: cluster 2024-09-21T05:03:12.027349+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:12.068692+0000 mon.c (mon.2) 106 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:12.069490+0000 mon.c (mon.2) 107 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:12.074923+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: audit 2024-09-21T05:03:12.327010+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[19831]: cluster 2024-09-21T05:03:12.442656+0000 mgr.y (mgr.14385) 143 : cluster [DBG] pgmap v117: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:11.973514+0000 mgr.y (mgr.14385) 139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: cephadm 2024-09-21T05:03:11.974786+0000 mgr.y (mgr.14385) 140 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:11.976031+0000 mgr.y (mgr.14385) 141 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:13.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:11.999892+0000 mgr.y (mgr.14385) 142 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:12.022356+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]': finished 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: cluster 2024-09-21T05:03:12.027349+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:12.068692+0000 mon.c (mon.2) 106 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:12.069490+0000 mon.c (mon.2) 107 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:12.074923+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: audit 2024-09-21T05:03:12.327010+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]: dispatch 2024-09-21T05:03:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:13 smithi089 bash[26514]: cluster 2024-09-21T05:03:12.442656+0000 mgr.y (mgr.14385) 143 : cluster [DBG] pgmap v117: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:11.973514+0000 mgr.y (mgr.14385) 139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:03:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: cephadm 2024-09-21T05:03:11.974786+0000 mgr.y (mgr.14385) 140 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:03:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:11.976031+0000 mgr.y (mgr.14385) 141 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:11.999892+0000 mgr.y (mgr.14385) 142 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:12.022356+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1270436840"}]': finished 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: cluster 2024-09-21T05:03:12.027349+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:12.068692+0000 mon.c (mon.2) 106 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:12.069490+0000 mon.c (mon.2) 107 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:12.074923+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: audit 2024-09-21T05:03:12.327010+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]: dispatch 2024-09-21T05:03:13.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:13 smithi110 bash[22020]: cluster 2024-09-21T05:03:12.442656+0000 mgr.y (mgr.14385) 143 : cluster [DBG] pgmap v117: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:14.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[19831]: audit 2024-09-21T05:03:13.081936+0000 mon.a (mon.0) 854 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]': finished 2024-09-21T05:03:14.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[19831]: cluster 2024-09-21T05:03:13.086418+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-21T05:03:14.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[19831]: audit 2024-09-21T05:03:13.380550+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]: dispatch 2024-09-21T05:03:14.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[26514]: audit 2024-09-21T05:03:13.081936+0000 mon.a (mon.0) 854 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]': finished 2024-09-21T05:03:14.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[26514]: cluster 2024-09-21T05:03:13.086418+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-21T05:03:14.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:14 smithi089 bash[26514]: audit 2024-09-21T05:03:13.380550+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]: dispatch 2024-09-21T05:03:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:14 smithi110 bash[22020]: audit 2024-09-21T05:03:13.081936+0000 mon.a (mon.0) 854 : audit [INF] from='client.? 172.21.15.89:0/1970383297' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4040295346"}]': finished 2024-09-21T05:03:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:14 smithi110 bash[22020]: cluster 2024-09-21T05:03:13.086418+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-09-21T05:03:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:14 smithi110 bash[22020]: audit 2024-09-21T05:03:13.380550+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]: dispatch 2024-09-21T05:03:15.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[19831]: audit 2024-09-21T05:03:14.084421+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]': finished 2024-09-21T05:03:15.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[19831]: cluster 2024-09-21T05:03:14.091661+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-21T05:03:15.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[19831]: audit 2024-09-21T05:03:14.398851+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]: dispatch 2024-09-21T05:03:15.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[19831]: cluster 2024-09-21T05:03:14.443308+0000 mgr.y (mgr.14385) 144 : cluster [DBG] pgmap v120: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:15.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[26514]: audit 2024-09-21T05:03:14.084421+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]': finished 2024-09-21T05:03:15.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[26514]: cluster 2024-09-21T05:03:14.091661+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-21T05:03:15.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[26514]: audit 2024-09-21T05:03:14.398851+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]: dispatch 2024-09-21T05:03:15.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:15 smithi089 bash[26514]: cluster 2024-09-21T05:03:14.443308+0000 mgr.y (mgr.14385) 144 : cluster [DBG] pgmap v120: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:15 smithi110 bash[22020]: audit 2024-09-21T05:03:14.084421+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.89:0/2793853550' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1926185681"}]': finished 2024-09-21T05:03:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:15 smithi110 bash[22020]: cluster 2024-09-21T05:03:14.091661+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-09-21T05:03:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:15 smithi110 bash[22020]: audit 2024-09-21T05:03:14.398851+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]: dispatch 2024-09-21T05:03:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:15 smithi110 bash[22020]: cluster 2024-09-21T05:03:14.443308+0000 mgr.y (mgr.14385) 144 : cluster [DBG] pgmap v120: 161 pgs: 3 peering, 158 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 255 B/s wr, 3 op/s 2024-09-21T05:03:16.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[19831]: audit 2024-09-21T05:03:15.103046+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]': finished 2024-09-21T05:03:16.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[19831]: cluster 2024-09-21T05:03:15.112114+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-21T05:03:16.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[19831]: audit 2024-09-21T05:03:15.420442+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]: dispatch 2024-09-21T05:03:16.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[26514]: audit 2024-09-21T05:03:15.103046+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]': finished 2024-09-21T05:03:16.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[26514]: cluster 2024-09-21T05:03:15.112114+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-21T05:03:16.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:16 smithi089 bash[26514]: audit 2024-09-21T05:03:15.420442+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]: dispatch 2024-09-21T05:03:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:16 smithi110 bash[22020]: audit 2024-09-21T05:03:15.103046+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.89:0/1583607817' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/1309687529"}]': finished 2024-09-21T05:03:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:16 smithi110 bash[22020]: cluster 2024-09-21T05:03:15.112114+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-09-21T05:03:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:16 smithi110 bash[22020]: audit 2024-09-21T05:03:15.420442+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]: dispatch 2024-09-21T05:03:17.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[19831]: audit 2024-09-21T05:03:16.105594+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]': finished 2024-09-21T05:03:17.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[19831]: cluster 2024-09-21T05:03:16.113046+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-21T05:03:17.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[19831]: audit 2024-09-21T05:03:16.423429+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]: dispatch 2024-09-21T05:03:17.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[19831]: cluster 2024-09-21T05:03:16.444423+0000 mgr.y (mgr.14385) 145 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:17.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[26514]: audit 2024-09-21T05:03:16.105594+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]': finished 2024-09-21T05:03:17.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[26514]: cluster 2024-09-21T05:03:16.113046+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-21T05:03:17.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[26514]: audit 2024-09-21T05:03:16.423429+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]: dispatch 2024-09-21T05:03:17.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:17 smithi089 bash[26514]: cluster 2024-09-21T05:03:16.444423+0000 mgr.y (mgr.14385) 145 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:17.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:17 smithi110 bash[22020]: audit 2024-09-21T05:03:16.105594+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.89:0/2492414719' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1926185681"}]': finished 2024-09-21T05:03:17.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:17 smithi110 bash[22020]: cluster 2024-09-21T05:03:16.113046+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-09-21T05:03:17.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:17 smithi110 bash[22020]: audit 2024-09-21T05:03:16.423429+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]: dispatch 2024-09-21T05:03:17.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:17 smithi110 bash[22020]: cluster 2024-09-21T05:03:16.444423+0000 mgr.y (mgr.14385) 145 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[19831]: audit 2024-09-21T05:03:17.126115+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]': finished 2024-09-21T05:03:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[19831]: cluster 2024-09-21T05:03:17.132873+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-21T05:03:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[19831]: audit 2024-09-21T05:03:17.440956+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]: dispatch 2024-09-21T05:03:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[26514]: audit 2024-09-21T05:03:17.126115+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]': finished 2024-09-21T05:03:18.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[26514]: cluster 2024-09-21T05:03:17.132873+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-21T05:03:18.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:18 smithi089 bash[26514]: audit 2024-09-21T05:03:17.440956+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]: dispatch 2024-09-21T05:03:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:18 smithi110 bash[22020]: audit 2024-09-21T05:03:17.126115+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.89:0/2804351589' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1007953151"}]': finished 2024-09-21T05:03:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:18 smithi110 bash[22020]: cluster 2024-09-21T05:03:17.132873+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-09-21T05:03:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:18 smithi110 bash[22020]: audit 2024-09-21T05:03:17.440956+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]: dispatch 2024-09-21T05:03:19.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: audit 2024-09-21T05:03:17.841220+0000 mgr.y (mgr.14385) 146 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:19.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: audit 2024-09-21T05:03:18.136055+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]': finished 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: cluster 2024-09-21T05:03:18.140385+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: cluster 2024-09-21T05:03:18.445049+0000 mgr.y (mgr.14385) 147 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: audit 2024-09-21T05:03:18.460216+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.89:0/258184259' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[19831]: audit 2024-09-21T05:03:18.461003+0000 mon.a (mon.0) 871 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: audit 2024-09-21T05:03:17.841220+0000 mgr.y (mgr.14385) 146 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: audit 2024-09-21T05:03:18.136055+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]': finished 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: cluster 2024-09-21T05:03:18.140385+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: cluster 2024-09-21T05:03:18.445049+0000 mgr.y (mgr.14385) 147 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: audit 2024-09-21T05:03:18.460216+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.89:0/258184259' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:19 smithi089 bash[26514]: audit 2024-09-21T05:03:18.461003+0000 mon.a (mon.0) 871 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: audit 2024-09-21T05:03:17.841220+0000 mgr.y (mgr.14385) 146 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: audit 2024-09-21T05:03:18.136055+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.89:0/900775331' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1787884428"}]': finished 2024-09-21T05:03:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: cluster 2024-09-21T05:03:18.140385+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-09-21T05:03:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: cluster 2024-09-21T05:03:18.445049+0000 mgr.y (mgr.14385) 147 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T05:03:19.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: audit 2024-09-21T05:03:18.460216+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.89:0/258184259' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:19.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:19 smithi110 bash[22020]: audit 2024-09-21T05:03:18.461003+0000 mon.a (mon.0) 871 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]: dispatch 2024-09-21T05:03:20.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[19831]: audit 2024-09-21T05:03:19.149249+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]': finished 2024-09-21T05:03:20.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[19831]: cluster 2024-09-21T05:03:19.160478+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-21T05:03:20.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[19831]: audit 2024-09-21T05:03:19.471248+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.89:0/2860802118' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:20.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[19831]: audit 2024-09-21T05:03:19.471990+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:20.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[26514]: audit 2024-09-21T05:03:19.149249+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]': finished 2024-09-21T05:03:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[26514]: cluster 2024-09-21T05:03:19.160478+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-21T05:03:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[26514]: audit 2024-09-21T05:03:19.471248+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.89:0/2860802118' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:20 smithi089 bash[26514]: audit 2024-09-21T05:03:19.471990+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:20 smithi110 bash[22020]: audit 2024-09-21T05:03:19.149249+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2018380474"}]': finished 2024-09-21T05:03:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:20 smithi110 bash[22020]: cluster 2024-09-21T05:03:19.160478+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-09-21T05:03:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:20 smithi110 bash[22020]: audit 2024-09-21T05:03:19.471248+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.89:0/2860802118' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:20 smithi110 bash[22020]: audit 2024-09-21T05:03:19.471990+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]: dispatch 2024-09-21T05:03:21.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[19831]: audit 2024-09-21T05:03:20.151709+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]': finished 2024-09-21T05:03:21.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[19831]: cluster 2024-09-21T05:03:20.157585+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-21T05:03:21.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[19831]: cluster 2024-09-21T05:03:20.445747+0000 mgr.y (mgr.14385) 148 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:21.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[19831]: audit 2024-09-21T05:03:20.478995+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]: dispatch 2024-09-21T05:03:21.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[26514]: audit 2024-09-21T05:03:20.151709+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]': finished 2024-09-21T05:03:21.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[26514]: cluster 2024-09-21T05:03:20.157585+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-21T05:03:21.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[26514]: cluster 2024-09-21T05:03:20.445747+0000 mgr.y (mgr.14385) 148 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:21.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[26514]: audit 2024-09-21T05:03:20.478995+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]: dispatch 2024-09-21T05:03:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:21 smithi110 bash[22020]: audit 2024-09-21T05:03:20.151709+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/1309687529"}]': finished 2024-09-21T05:03:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:21 smithi110 bash[22020]: cluster 2024-09-21T05:03:20.157585+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-09-21T05:03:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:21 smithi110 bash[22020]: cluster 2024-09-21T05:03:20.445747+0000 mgr.y (mgr.14385) 148 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 261 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:03:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:21 smithi110 bash[22020]: audit 2024-09-21T05:03:20.478995+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]: dispatch 2024-09-21T05:03:22.196 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:21] "GET /metrics HTTP/1.1" 200 38150 "" "Prometheus/2.43.0" 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[19831]: audit 2024-09-21T05:03:21.180138+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]': finished 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[19831]: cluster 2024-09-21T05:03:21.185079+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[19831]: audit 2024-09-21T05:03:21.501694+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.89:0/4052618329' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[19831]: audit 2024-09-21T05:03:21.502582+0000 mon.a (mon.0) 880 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[26514]: audit 2024-09-21T05:03:21.180138+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]': finished 2024-09-21T05:03:22.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[26514]: cluster 2024-09-21T05:03:21.185079+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-21T05:03:22.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[26514]: audit 2024-09-21T05:03:21.501694+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.89:0/4052618329' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:22.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:22 smithi089 bash[26514]: audit 2024-09-21T05:03:21.502582+0000 mon.a (mon.0) 880 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:22.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:22 smithi110 bash[22020]: audit 2024-09-21T05:03:21.180138+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.89:0/3847930869' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1588549793"}]': finished 2024-09-21T05:03:22.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:22 smithi110 bash[22020]: cluster 2024-09-21T05:03:21.185079+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-09-21T05:03:22.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:22 smithi110 bash[22020]: audit 2024-09-21T05:03:21.501694+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.89:0/4052618329' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:22.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:22 smithi110 bash[22020]: audit 2024-09-21T05:03:21.502582+0000 mon.a (mon.0) 880 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]: dispatch 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[19831]: audit 2024-09-21T05:03:22.182716+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]': finished 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[19831]: cluster 2024-09-21T05:03:22.191676+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[19831]: cluster 2024-09-21T05:03:22.446238+0000 mgr.y (mgr.14385) 149 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[19831]: audit 2024-09-21T05:03:22.509928+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]: dispatch 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[26514]: audit 2024-09-21T05:03:22.182716+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]': finished 2024-09-21T05:03:23.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[26514]: cluster 2024-09-21T05:03:22.191676+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-21T05:03:23.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[26514]: cluster 2024-09-21T05:03:22.446238+0000 mgr.y (mgr.14385) 149 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:23.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:23 smithi089 bash[26514]: audit 2024-09-21T05:03:22.509928+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]: dispatch 2024-09-21T05:03:23.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:23 smithi110 bash[22020]: audit 2024-09-21T05:03:22.182716+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2247079945"}]': finished 2024-09-21T05:03:23.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:23 smithi110 bash[22020]: cluster 2024-09-21T05:03:22.191676+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-09-21T05:03:23.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:23 smithi110 bash[22020]: cluster 2024-09-21T05:03:22.446238+0000 mgr.y (mgr.14385) 149 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:23.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:23 smithi110 bash[22020]: audit 2024-09-21T05:03:22.509928+0000 mon.a (mon.0) 883 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]: dispatch 2024-09-21T05:03:24.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[19831]: audit 2024-09-21T05:03:23.210730+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]': finished 2024-09-21T05:03:24.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[19831]: cluster 2024-09-21T05:03:23.218073+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-21T05:03:24.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[19831]: audit 2024-09-21T05:03:23.520762+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.89:0/916504291' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:24.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[19831]: audit 2024-09-21T05:03:23.521631+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:24.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[26514]: audit 2024-09-21T05:03:23.210730+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]': finished 2024-09-21T05:03:24.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[26514]: cluster 2024-09-21T05:03:23.218073+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-21T05:03:24.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[26514]: audit 2024-09-21T05:03:23.520762+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.89:0/916504291' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:24.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:24 smithi089 bash[26514]: audit 2024-09-21T05:03:23.521631+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:24.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:24 smithi110 bash[22020]: audit 2024-09-21T05:03:23.210730+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.89:0/3981780200' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/563715280"}]': finished 2024-09-21T05:03:24.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:24 smithi110 bash[22020]: cluster 2024-09-21T05:03:23.218073+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-09-21T05:03:24.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:24 smithi110 bash[22020]: audit 2024-09-21T05:03:23.520762+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.89:0/916504291' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:24.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:24 smithi110 bash[22020]: audit 2024-09-21T05:03:23.521631+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]: dispatch 2024-09-21T05:03:25.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[26514]: audit 2024-09-21T05:03:24.223136+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]': finished 2024-09-21T05:03:25.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[26514]: cluster 2024-09-21T05:03:24.230679+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-21T05:03:25.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[26514]: cluster 2024-09-21T05:03:24.446931+0000 mgr.y (mgr.14385) 150 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:25.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[19831]: audit 2024-09-21T05:03:24.223136+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]': finished 2024-09-21T05:03:25.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[19831]: cluster 2024-09-21T05:03:24.230679+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-21T05:03:25.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:25 smithi089 bash[19831]: cluster 2024-09-21T05:03:24.446931+0000 mgr.y (mgr.14385) 150 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:25.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:25 smithi110 bash[22020]: audit 2024-09-21T05:03:24.223136+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2247079945"}]': finished 2024-09-21T05:03:25.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:25 smithi110 bash[22020]: cluster 2024-09-21T05:03:24.230679+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-09-21T05:03:25.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:25 smithi110 bash[22020]: cluster 2024-09-21T05:03:24.446931+0000 mgr.y (mgr.14385) 150 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:26.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:26 smithi089 bash[19831]: audit 2024-09-21T05:03:25.503653+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:26.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:26 smithi089 bash[26514]: audit 2024-09-21T05:03:25.503653+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:26.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:26 smithi110 bash[22020]: audit 2024-09-21T05:03:25.503653+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:27.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:27 smithi089 bash[19831]: cluster 2024-09-21T05:03:26.448532+0000 mgr.y (mgr.14385) 151 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:03:27.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:27 smithi089 bash[26514]: cluster 2024-09-21T05:03:26.448532+0000 mgr.y (mgr.14385) 151 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:03:27.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:27 smithi110 bash[22020]: cluster 2024-09-21T05:03:26.448532+0000 mgr.y (mgr.14385) 151 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-21T05:03:29.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:29 smithi089 bash[19831]: audit 2024-09-21T05:03:27.852983+0000 mgr.y (mgr.14385) 152 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:29.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:29 smithi089 bash[19831]: cluster 2024-09-21T05:03:28.449238+0000 mgr.y (mgr.14385) 153 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-21T05:03:29.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:29 smithi089 bash[26514]: audit 2024-09-21T05:03:27.852983+0000 mgr.y (mgr.14385) 152 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:29.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:29 smithi089 bash[26514]: cluster 2024-09-21T05:03:28.449238+0000 mgr.y (mgr.14385) 153 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-21T05:03:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:29 smithi110 bash[22020]: audit 2024-09-21T05:03:27.852983+0000 mgr.y (mgr.14385) 152 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:29 smithi110 bash[22020]: cluster 2024-09-21T05:03:28.449238+0000 mgr.y (mgr.14385) 153 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 817 B/s rd, 0 op/s 2024-09-21T05:03:31.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:31 smithi089 bash[19831]: cluster 2024-09-21T05:03:30.449957+0000 mgr.y (mgr.14385) 154 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:03:31.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:31 smithi089 bash[26514]: cluster 2024-09-21T05:03:30.449957+0000 mgr.y (mgr.14385) 154 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:03:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:31 smithi110 bash[22020]: cluster 2024-09-21T05:03:30.449957+0000 mgr.y (mgr.14385) 154 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:03:32.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:31] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:03:33.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:33 smithi089 bash[19831]: cluster 2024-09-21T05:03:32.451578+0000 mgr.y (mgr.14385) 155 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:03:33.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:33 smithi089 bash[26514]: cluster 2024-09-21T05:03:32.451578+0000 mgr.y (mgr.14385) 155 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:03:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:33 smithi110 bash[22020]: cluster 2024-09-21T05:03:32.451578+0000 mgr.y (mgr.14385) 155 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:03:35.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:35 smithi089 bash[19831]: cluster 2024-09-21T05:03:34.452265+0000 mgr.y (mgr.14385) 156 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-09-21T05:03:35.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:35 smithi089 bash[26514]: cluster 2024-09-21T05:03:34.452265+0000 mgr.y (mgr.14385) 156 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-09-21T05:03:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:35 smithi110 bash[22020]: cluster 2024-09-21T05:03:34.452265+0000 mgr.y (mgr.14385) 156 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-09-21T05:03:37.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:37 smithi089 bash[19831]: cluster 2024-09-21T05:03:36.453892+0000 mgr.y (mgr.14385) 157 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:37.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:37 smithi089 bash[26514]: cluster 2024-09-21T05:03:36.453892+0000 mgr.y (mgr.14385) 157 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:37 smithi110 bash[22020]: cluster 2024-09-21T05:03:36.453892+0000 mgr.y (mgr.14385) 157 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:39.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:39 smithi089 bash[19831]: audit 2024-09-21T05:03:37.861457+0000 mgr.y (mgr.14385) 158 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:39.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:39 smithi089 bash[19831]: cluster 2024-09-21T05:03:38.454597+0000 mgr.y (mgr.14385) 159 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:39.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:39 smithi089 bash[26514]: audit 2024-09-21T05:03:37.861457+0000 mgr.y (mgr.14385) 158 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:39.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:39 smithi089 bash[26514]: cluster 2024-09-21T05:03:38.454597+0000 mgr.y (mgr.14385) 159 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:39 smithi110 bash[22020]: audit 2024-09-21T05:03:37.861457+0000 mgr.y (mgr.14385) 158 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:39 smithi110 bash[22020]: cluster 2024-09-21T05:03:38.454597+0000 mgr.y (mgr.14385) 159 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:40.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:40 smithi089 bash[19831]: audit 2024-09-21T05:03:40.504192+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:40.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:40 smithi089 bash[26514]: audit 2024-09-21T05:03:40.504192+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:40 smithi110 bash[22020]: audit 2024-09-21T05:03:40.504192+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:41.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:41 smithi089 bash[19831]: cluster 2024-09-21T05:03:40.455303+0000 mgr.y (mgr.14385) 160 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:41.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:41 smithi089 bash[26514]: cluster 2024-09-21T05:03:40.455303+0000 mgr.y (mgr.14385) 160 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:41 smithi110 bash[22020]: cluster 2024-09-21T05:03:40.455303+0000 mgr.y (mgr.14385) 160 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:42.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:41] "GET /metrics HTTP/1.1" 200 38161 "" "Prometheus/2.43.0" 2024-09-21T05:03:43.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:43 smithi089 bash[19831]: cluster 2024-09-21T05:03:42.456960+0000 mgr.y (mgr.14385) 161 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:43.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:43 smithi089 bash[26514]: cluster 2024-09-21T05:03:42.456960+0000 mgr.y (mgr.14385) 161 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:43.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:43 smithi110 bash[22020]: cluster 2024-09-21T05:03:42.456960+0000 mgr.y (mgr.14385) 161 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:45 smithi110 bash[22020]: cluster 2024-09-21T05:03:44.457652+0000 mgr.y (mgr.14385) 162 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:46.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:45 smithi089 bash[19831]: cluster 2024-09-21T05:03:44.457652+0000 mgr.y (mgr.14385) 162 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:46.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:45 smithi089 bash[26514]: cluster 2024-09-21T05:03:44.457652+0000 mgr.y (mgr.14385) 162 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:47 smithi110 bash[22020]: cluster 2024-09-21T05:03:46.459221+0000 mgr.y (mgr.14385) 163 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:47.871 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:47 smithi089 bash[19831]: cluster 2024-09-21T05:03:46.459221+0000 mgr.y (mgr.14385) 163 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:47.871 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:47 smithi089 bash[26514]: cluster 2024-09-21T05:03:46.459221+0000 mgr.y (mgr.14385) 163 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:50.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:49 smithi089 bash[19831]: audit 2024-09-21T05:03:47.872648+0000 mgr.y (mgr.14385) 164 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:50.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:49 smithi089 bash[19831]: cluster 2024-09-21T05:03:48.459902+0000 mgr.y (mgr.14385) 165 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:50.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:49 smithi089 bash[26514]: audit 2024-09-21T05:03:47.872648+0000 mgr.y (mgr.14385) 164 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:50.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:49 smithi089 bash[26514]: cluster 2024-09-21T05:03:48.459902+0000 mgr.y (mgr.14385) 165 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:49 smithi110 bash[22020]: audit 2024-09-21T05:03:47.872648+0000 mgr.y (mgr.14385) 164 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:03:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:49 smithi110 bash[22020]: cluster 2024-09-21T05:03:48.459902+0000 mgr.y (mgr.14385) 165 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:52.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:03:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:03:51] "GET /metrics HTTP/1.1" 200 38161 "" "Prometheus/2.43.0" 2024-09-21T05:03:52.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:51 smithi089 bash[26514]: cluster 2024-09-21T05:03:50.460572+0000 mgr.y (mgr.14385) 166 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:52.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:51 smithi089 bash[19831]: cluster 2024-09-21T05:03:50.460572+0000 mgr.y (mgr.14385) 166 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:51 smithi110 bash[22020]: cluster 2024-09-21T05:03:50.460572+0000 mgr.y (mgr.14385) 166 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:54.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:53 smithi089 bash[19831]: cluster 2024-09-21T05:03:52.462237+0000 mgr.y (mgr.14385) 167 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:54.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:53 smithi089 bash[26514]: cluster 2024-09-21T05:03:52.462237+0000 mgr.y (mgr.14385) 167 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:53 smithi110 bash[22020]: cluster 2024-09-21T05:03:52.462237+0000 mgr.y (mgr.14385) 167 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:56.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:55 smithi089 bash[19831]: cluster 2024-09-21T05:03:54.462898+0000 mgr.y (mgr.14385) 168 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:56.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:55 smithi089 bash[19831]: audit 2024-09-21T05:03:55.504733+0000 mon.c (mon.2) 114 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:55 smithi089 bash[26514]: cluster 2024-09-21T05:03:54.462898+0000 mgr.y (mgr.14385) 168 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:55 smithi089 bash[26514]: audit 2024-09-21T05:03:55.504733+0000 mon.c (mon.2) 114 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:55 smithi110 bash[22020]: cluster 2024-09-21T05:03:54.462898+0000 mgr.y (mgr.14385) 168 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:03:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:55 smithi110 bash[22020]: audit 2024-09-21T05:03:55.504733+0000 mon.c (mon.2) 114 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:03:57.882 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:57 smithi089 bash[19831]: cluster 2024-09-21T05:03:56.464480+0000 mgr.y (mgr.14385) 169 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:57.883 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:57 smithi089 bash[26514]: cluster 2024-09-21T05:03:56.464480+0000 mgr.y (mgr.14385) 169 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:03:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:57 smithi110 bash[22020]: cluster 2024-09-21T05:03:56.464480+0000 mgr.y (mgr.14385) 169 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:00.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:59 smithi089 bash[26514]: audit 2024-09-21T05:03:57.883870+0000 mgr.y (mgr.14385) 170 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:00.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:03:59 smithi089 bash[26514]: cluster 2024-09-21T05:03:58.465189+0000 mgr.y (mgr.14385) 171 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:00.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:59 smithi089 bash[19831]: audit 2024-09-21T05:03:57.883870+0000 mgr.y (mgr.14385) 170 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:00.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:03:59 smithi089 bash[19831]: cluster 2024-09-21T05:03:58.465189+0000 mgr.y (mgr.14385) 171 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:59 smithi110 bash[22020]: audit 2024-09-21T05:03:57.883870+0000 mgr.y (mgr.14385) 170 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:03:59 smithi110 bash[22020]: cluster 2024-09-21T05:03:58.465189+0000 mgr.y (mgr.14385) 171 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:02.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:01 smithi089 bash[19831]: cluster 2024-09-21T05:04:00.465880+0000 mgr.y (mgr.14385) 172 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:02.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:01] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:04:02.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:01 smithi089 bash[26514]: cluster 2024-09-21T05:04:00.465880+0000 mgr.y (mgr.14385) 172 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:01 smithi110 bash[22020]: cluster 2024-09-21T05:04:00.465880+0000 mgr.y (mgr.14385) 172 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:04.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:03 smithi089 bash[19831]: cluster 2024-09-21T05:04:02.467492+0000 mgr.y (mgr.14385) 173 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:04.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:03 smithi089 bash[26514]: cluster 2024-09-21T05:04:02.467492+0000 mgr.y (mgr.14385) 173 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:03 smithi110 bash[22020]: cluster 2024-09-21T05:04:02.467492+0000 mgr.y (mgr.14385) 173 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:06.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:05 smithi089 bash[19831]: cluster 2024-09-21T05:04:04.468155+0000 mgr.y (mgr.14385) 174 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:05 smithi089 bash[26514]: cluster 2024-09-21T05:04:04.468155+0000 mgr.y (mgr.14385) 174 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:05 smithi110 bash[22020]: cluster 2024-09-21T05:04:04.468155+0000 mgr.y (mgr.14385) 174 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:07.893 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:07 smithi089 bash[19831]: cluster 2024-09-21T05:04:06.469811+0000 mgr.y (mgr.14385) 175 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:07.894 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:07 smithi089 bash[26514]: cluster 2024-09-21T05:04:06.469811+0000 mgr.y (mgr.14385) 175 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:07 smithi110 bash[22020]: cluster 2024-09-21T05:04:06.469811+0000 mgr.y (mgr.14385) 175 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:10.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:09 smithi089 bash[19831]: audit 2024-09-21T05:04:07.895196+0000 mgr.y (mgr.14385) 176 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:10.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:09 smithi089 bash[19831]: cluster 2024-09-21T05:04:08.470436+0000 mgr.y (mgr.14385) 177 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:10.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:09 smithi089 bash[26514]: audit 2024-09-21T05:04:07.895196+0000 mgr.y (mgr.14385) 176 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:10.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:09 smithi089 bash[26514]: cluster 2024-09-21T05:04:08.470436+0000 mgr.y (mgr.14385) 177 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:09 smithi110 bash[22020]: audit 2024-09-21T05:04:07.895196+0000 mgr.y (mgr.14385) 176 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:09 smithi110 bash[22020]: cluster 2024-09-21T05:04:08.470436+0000 mgr.y (mgr.14385) 177 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:10 smithi089 bash[19831]: audit 2024-09-21T05:04:10.507001+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:11.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:10 smithi089 bash[26514]: audit 2024-09-21T05:04:10.507001+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:10 smithi110 bash[22020]: audit 2024-09-21T05:04:10.507001+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:12.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:11 smithi089 bash[19831]: cluster 2024-09-21T05:04:10.471094+0000 mgr.y (mgr.14385) 178 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:12.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:11] "GET /metrics HTTP/1.1" 200 38159 "" "Prometheus/2.43.0" 2024-09-21T05:04:12.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:11 smithi089 bash[26514]: cluster 2024-09-21T05:04:10.471094+0000 mgr.y (mgr.14385) 178 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:11 smithi110 bash[22020]: cluster 2024-09-21T05:04:10.471094+0000 mgr.y (mgr.14385) 178 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[19831]: cluster 2024-09-21T05:04:12.472706+0000 mgr.y (mgr.14385) 179 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[19831]: audit 2024-09-21T05:04:12.905184+0000 mon.c (mon.2) 116 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[19831]: audit 2024-09-21T05:04:12.906699+0000 mon.c (mon.2) 117 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[19831]: audit 2024-09-21T05:04:12.916205+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[26514]: cluster 2024-09-21T05:04:12.472706+0000 mgr.y (mgr.14385) 179 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[26514]: audit 2024-09-21T05:04:12.905184+0000 mon.c (mon.2) 116 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[26514]: audit 2024-09-21T05:04:12.906699+0000 mon.c (mon.2) 117 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:13 smithi089 bash[26514]: audit 2024-09-21T05:04:12.916205+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:04:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:13 smithi110 bash[22020]: cluster 2024-09-21T05:04:12.472706+0000 mgr.y (mgr.14385) 179 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:13 smithi110 bash[22020]: audit 2024-09-21T05:04:12.905184+0000 mon.c (mon.2) 116 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:04:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:13 smithi110 bash[22020]: audit 2024-09-21T05:04:12.906699+0000 mon.c (mon.2) 117 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:04:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:13 smithi110 bash[22020]: audit 2024-09-21T05:04:12.916205+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:04:16.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:15 smithi089 bash[19831]: cluster 2024-09-21T05:04:14.473396+0000 mgr.y (mgr.14385) 180 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:16.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:15 smithi089 bash[26514]: cluster 2024-09-21T05:04:14.473396+0000 mgr.y (mgr.14385) 180 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:15 smithi110 bash[22020]: cluster 2024-09-21T05:04:14.473396+0000 mgr.y (mgr.14385) 180 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:17.903 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:17 smithi089 bash[19831]: cluster 2024-09-21T05:04:16.475032+0000 mgr.y (mgr.14385) 181 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:17.903 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:17 smithi089 bash[26514]: cluster 2024-09-21T05:04:16.475032+0000 mgr.y (mgr.14385) 181 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:17 smithi110 bash[22020]: cluster 2024-09-21T05:04:16.475032+0000 mgr.y (mgr.14385) 181 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:19 smithi089 bash[19831]: audit 2024-09-21T05:04:17.904875+0000 mgr.y (mgr.14385) 182 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:20.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:19 smithi089 bash[19831]: cluster 2024-09-21T05:04:18.475713+0000 mgr.y (mgr.14385) 183 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:20.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:19 smithi089 bash[26514]: audit 2024-09-21T05:04:17.904875+0000 mgr.y (mgr.14385) 182 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:20.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:19 smithi089 bash[26514]: cluster 2024-09-21T05:04:18.475713+0000 mgr.y (mgr.14385) 183 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:19 smithi110 bash[22020]: audit 2024-09-21T05:04:17.904875+0000 mgr.y (mgr.14385) 182 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:19 smithi110 bash[22020]: cluster 2024-09-21T05:04:18.475713+0000 mgr.y (mgr.14385) 183 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:22.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:21] "GET /metrics HTTP/1.1" 200 38159 "" "Prometheus/2.43.0" 2024-09-21T05:04:22.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:21 smithi089 bash[19831]: cluster 2024-09-21T05:04:20.476360+0000 mgr.y (mgr.14385) 184 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:22.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:21 smithi089 bash[26514]: cluster 2024-09-21T05:04:20.476360+0000 mgr.y (mgr.14385) 184 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:21 smithi110 bash[22020]: cluster 2024-09-21T05:04:20.476360+0000 mgr.y (mgr.14385) 184 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:24.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:23 smithi089 bash[26514]: cluster 2024-09-21T05:04:22.478071+0000 mgr.y (mgr.14385) 185 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:24.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:23 smithi089 bash[19831]: cluster 2024-09-21T05:04:22.478071+0000 mgr.y (mgr.14385) 185 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:24.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:23 smithi110 bash[22020]: cluster 2024-09-21T05:04:22.478071+0000 mgr.y (mgr.14385) 185 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:26.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:25 smithi089 bash[26514]: cluster 2024-09-21T05:04:24.478801+0000 mgr.y (mgr.14385) 186 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:26.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:25 smithi089 bash[26514]: audit 2024-09-21T05:04:25.507742+0000 mon.c (mon.2) 118 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:26.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:25 smithi089 bash[19831]: cluster 2024-09-21T05:04:24.478801+0000 mgr.y (mgr.14385) 186 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:26.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:25 smithi089 bash[19831]: audit 2024-09-21T05:04:25.507742+0000 mon.c (mon.2) 118 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:25 smithi110 bash[22020]: cluster 2024-09-21T05:04:24.478801+0000 mgr.y (mgr.14385) 186 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:25 smithi110 bash[22020]: audit 2024-09-21T05:04:25.507742+0000 mon.c (mon.2) 118 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:27.912 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:27 smithi089 bash[26514]: cluster 2024-09-21T05:04:26.480361+0000 mgr.y (mgr.14385) 187 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:27.913 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:27 smithi089 bash[19831]: cluster 2024-09-21T05:04:26.480361+0000 mgr.y (mgr.14385) 187 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:27 smithi110 bash[22020]: cluster 2024-09-21T05:04:26.480361+0000 mgr.y (mgr.14385) 187 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:30.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:29 smithi089 bash[26514]: audit 2024-09-21T05:04:27.914285+0000 mgr.y (mgr.14385) 188 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:30.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:29 smithi089 bash[26514]: cluster 2024-09-21T05:04:28.481039+0000 mgr.y (mgr.14385) 189 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:30.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:29 smithi089 bash[19831]: audit 2024-09-21T05:04:27.914285+0000 mgr.y (mgr.14385) 188 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:30.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:29 smithi089 bash[19831]: cluster 2024-09-21T05:04:28.481039+0000 mgr.y (mgr.14385) 189 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:29 smithi110 bash[22020]: audit 2024-09-21T05:04:27.914285+0000 mgr.y (mgr.14385) 188 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:29 smithi110 bash[22020]: cluster 2024-09-21T05:04:28.481039+0000 mgr.y (mgr.14385) 189 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:32.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:31 smithi089 bash[19831]: cluster 2024-09-21T05:04:30.481791+0000 mgr.y (mgr.14385) 190 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:32.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:31] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:04:32.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:31 smithi089 bash[26514]: cluster 2024-09-21T05:04:30.481791+0000 mgr.y (mgr.14385) 190 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:31 smithi110 bash[22020]: cluster 2024-09-21T05:04:30.481791+0000 mgr.y (mgr.14385) 190 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:34.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:33 smithi089 bash[19831]: cluster 2024-09-21T05:04:32.483454+0000 mgr.y (mgr.14385) 191 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:34.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:33 smithi089 bash[26514]: cluster 2024-09-21T05:04:32.483454+0000 mgr.y (mgr.14385) 191 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:33 smithi110 bash[22020]: cluster 2024-09-21T05:04:32.483454+0000 mgr.y (mgr.14385) 191 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:36.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:35 smithi089 bash[19831]: cluster 2024-09-21T05:04:34.484141+0000 mgr.y (mgr.14385) 192 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:36.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:35 smithi089 bash[26514]: cluster 2024-09-21T05:04:34.484141+0000 mgr.y (mgr.14385) 192 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:35 smithi110 bash[22020]: cluster 2024-09-21T05:04:34.484141+0000 mgr.y (mgr.14385) 192 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:37.923 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:37 smithi089 bash[19831]: cluster 2024-09-21T05:04:36.485743+0000 mgr.y (mgr.14385) 193 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:37.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:37 smithi089 bash[26514]: cluster 2024-09-21T05:04:36.485743+0000 mgr.y (mgr.14385) 193 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:37 smithi110 bash[22020]: cluster 2024-09-21T05:04:36.485743+0000 mgr.y (mgr.14385) 193 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:40.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:39 smithi089 bash[19831]: audit 2024-09-21T05:04:37.925664+0000 mgr.y (mgr.14385) 194 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:40.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:39 smithi089 bash[19831]: cluster 2024-09-21T05:04:38.486438+0000 mgr.y (mgr.14385) 195 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:40.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:39 smithi089 bash[26514]: audit 2024-09-21T05:04:37.925664+0000 mgr.y (mgr.14385) 194 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:40.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:39 smithi089 bash[26514]: cluster 2024-09-21T05:04:38.486438+0000 mgr.y (mgr.14385) 195 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:39 smithi110 bash[22020]: audit 2024-09-21T05:04:37.925664+0000 mgr.y (mgr.14385) 194 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:40.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:39 smithi110 bash[22020]: cluster 2024-09-21T05:04:38.486438+0000 mgr.y (mgr.14385) 195 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:41.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:40 smithi089 bash[19831]: audit 2024-09-21T05:04:40.507946+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:41.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:40 smithi089 bash[26514]: audit 2024-09-21T05:04:40.507946+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:40 smithi110 bash[22020]: audit 2024-09-21T05:04:40.507946+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:42.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:41 smithi089 bash[19831]: cluster 2024-09-21T05:04:40.487145+0000 mgr.y (mgr.14385) 196 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:42.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:41] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:04:42.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:41 smithi089 bash[26514]: cluster 2024-09-21T05:04:40.487145+0000 mgr.y (mgr.14385) 196 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:41 smithi110 bash[22020]: cluster 2024-09-21T05:04:40.487145+0000 mgr.y (mgr.14385) 196 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:43.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:42 smithi089 bash[19831]: cluster 2024-09-21T05:04:42.488791+0000 mgr.y (mgr.14385) 197 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:43.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:42 smithi089 bash[26514]: cluster 2024-09-21T05:04:42.488791+0000 mgr.y (mgr.14385) 197 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:42 smithi110 bash[22020]: cluster 2024-09-21T05:04:42.488791+0000 mgr.y (mgr.14385) 197 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:45.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:45 smithi089 bash[26514]: cluster 2024-09-21T05:04:44.489502+0000 mgr.y (mgr.14385) 198 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:45.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:45 smithi089 bash[19831]: cluster 2024-09-21T05:04:44.489502+0000 mgr.y (mgr.14385) 198 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:45.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:45 smithi110 bash[22020]: cluster 2024-09-21T05:04:44.489502+0000 mgr.y (mgr.14385) 198 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:47 smithi110 bash[22020]: cluster 2024-09-21T05:04:46.491039+0000 mgr.y (mgr.14385) 199 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:47.935 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:47 smithi089 bash[19831]: cluster 2024-09-21T05:04:46.491039+0000 mgr.y (mgr.14385) 199 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:47.935 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:47 smithi089 bash[26514]: cluster 2024-09-21T05:04:46.491039+0000 mgr.y (mgr.14385) 199 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:49 smithi110 bash[22020]: audit 2024-09-21T05:04:47.936883+0000 mgr.y (mgr.14385) 200 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:49 smithi110 bash[22020]: cluster 2024-09-21T05:04:48.491742+0000 mgr.y (mgr.14385) 201 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:50.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:49 smithi089 bash[19831]: audit 2024-09-21T05:04:47.936883+0000 mgr.y (mgr.14385) 200 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:50.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:49 smithi089 bash[19831]: cluster 2024-09-21T05:04:48.491742+0000 mgr.y (mgr.14385) 201 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:50.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:49 smithi089 bash[26514]: audit 2024-09-21T05:04:47.936883+0000 mgr.y (mgr.14385) 200 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:04:50.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:49 smithi089 bash[26514]: cluster 2024-09-21T05:04:48.491742+0000 mgr.y (mgr.14385) 201 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:52.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:51 smithi089 bash[19831]: cluster 2024-09-21T05:04:50.492470+0000 mgr.y (mgr.14385) 202 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:52.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:04:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:04:51] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:04:52.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:51 smithi089 bash[26514]: cluster 2024-09-21T05:04:50.492470+0000 mgr.y (mgr.14385) 202 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:51 smithi110 bash[22020]: cluster 2024-09-21T05:04:50.492470+0000 mgr.y (mgr.14385) 202 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:54.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:53 smithi089 bash[19831]: cluster 2024-09-21T05:04:52.494185+0000 mgr.y (mgr.14385) 203 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:54.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:53 smithi089 bash[26514]: cluster 2024-09-21T05:04:52.494185+0000 mgr.y (mgr.14385) 203 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:53 smithi110 bash[22020]: cluster 2024-09-21T05:04:52.494185+0000 mgr.y (mgr.14385) 203 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:56.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:55 smithi089 bash[19831]: cluster 2024-09-21T05:04:54.494864+0000 mgr.y (mgr.14385) 204 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:56.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:55 smithi089 bash[19831]: audit 2024-09-21T05:04:55.508383+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:55 smithi089 bash[26514]: cluster 2024-09-21T05:04:54.494864+0000 mgr.y (mgr.14385) 204 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:56.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:55 smithi089 bash[26514]: audit 2024-09-21T05:04:55.508383+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:55 smithi110 bash[22020]: cluster 2024-09-21T05:04:54.494864+0000 mgr.y (mgr.14385) 204 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:04:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:55 smithi110 bash[22020]: audit 2024-09-21T05:04:55.508383+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:04:57.944 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:57 smithi089 bash[19831]: cluster 2024-09-21T05:04:56.496533+0000 mgr.y (mgr.14385) 205 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:57.944 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:57 smithi089 bash[26514]: cluster 2024-09-21T05:04:56.496533+0000 mgr.y (mgr.14385) 205 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:04:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:57 smithi110 bash[22020]: cluster 2024-09-21T05:04:56.496533+0000 mgr.y (mgr.14385) 205 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:00.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:59 smithi089 bash[19831]: audit 2024-09-21T05:04:57.946165+0000 mgr.y (mgr.14385) 206 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:00.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:04:59 smithi089 bash[19831]: cluster 2024-09-21T05:04:58.497167+0000 mgr.y (mgr.14385) 207 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:00.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:59 smithi089 bash[26514]: audit 2024-09-21T05:04:57.946165+0000 mgr.y (mgr.14385) 206 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:00.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:04:59 smithi089 bash[26514]: cluster 2024-09-21T05:04:58.497167+0000 mgr.y (mgr.14385) 207 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:59 smithi110 bash[22020]: audit 2024-09-21T05:04:57.946165+0000 mgr.y (mgr.14385) 206 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:04:59 smithi110 bash[22020]: cluster 2024-09-21T05:04:58.497167+0000 mgr.y (mgr.14385) 207 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:01.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:01 smithi110 bash[22020]: cluster 2024-09-21T05:05:00.497914+0000 mgr.y (mgr.14385) 208 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:02.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:01 smithi089 bash[19831]: cluster 2024-09-21T05:05:00.497914+0000 mgr.y (mgr.14385) 208 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:02.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:01] "GET /metrics HTTP/1.1" 200 38163 "" "Prometheus/2.43.0" 2024-09-21T05:05:02.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:01 smithi089 bash[26514]: cluster 2024-09-21T05:05:00.497914+0000 mgr.y (mgr.14385) 208 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:04.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:03 smithi089 bash[26514]: cluster 2024-09-21T05:05:02.499511+0000 mgr.y (mgr.14385) 209 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:04.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:03 smithi089 bash[19831]: cluster 2024-09-21T05:05:02.499511+0000 mgr.y (mgr.14385) 209 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:03 smithi110 bash[22020]: cluster 2024-09-21T05:05:02.499511+0000 mgr.y (mgr.14385) 209 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:06.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:05 smithi089 bash[26514]: cluster 2024-09-21T05:05:04.500203+0000 mgr.y (mgr.14385) 210 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:06.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:05 smithi089 bash[19831]: cluster 2024-09-21T05:05:04.500203+0000 mgr.y (mgr.14385) 210 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:05 smithi110 bash[22020]: cluster 2024-09-21T05:05:04.500203+0000 mgr.y (mgr.14385) 210 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:07.955 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:07 smithi089 bash[26514]: cluster 2024-09-21T05:05:06.501862+0000 mgr.y (mgr.14385) 211 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:07.955 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:07 smithi089 bash[19831]: cluster 2024-09-21T05:05:06.501862+0000 mgr.y (mgr.14385) 211 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:07 smithi110 bash[22020]: cluster 2024-09-21T05:05:06.501862+0000 mgr.y (mgr.14385) 211 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:10.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:09 smithi089 bash[26514]: audit 2024-09-21T05:05:07.957427+0000 mgr.y (mgr.14385) 212 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:10.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:09 smithi089 bash[26514]: cluster 2024-09-21T05:05:08.502548+0000 mgr.y (mgr.14385) 213 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:10.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:09 smithi089 bash[19831]: audit 2024-09-21T05:05:07.957427+0000 mgr.y (mgr.14385) 212 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:10.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:09 smithi089 bash[19831]: cluster 2024-09-21T05:05:08.502548+0000 mgr.y (mgr.14385) 213 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:09 smithi110 bash[22020]: audit 2024-09-21T05:05:07.957427+0000 mgr.y (mgr.14385) 212 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:09 smithi110 bash[22020]: cluster 2024-09-21T05:05:08.502548+0000 mgr.y (mgr.14385) 213 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:11.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:10 smithi089 bash[19831]: audit 2024-09-21T05:05:10.508861+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:11.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:10 smithi089 bash[26514]: audit 2024-09-21T05:05:10.508861+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:10 smithi110 bash[22020]: audit 2024-09-21T05:05:10.508861+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:12.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:11] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:05:12.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:11 smithi089 bash[26514]: cluster 2024-09-21T05:05:10.503239+0000 mgr.y (mgr.14385) 214 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:12.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:11 smithi089 bash[19831]: cluster 2024-09-21T05:05:10.503239+0000 mgr.y (mgr.14385) 214 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:11 smithi110 bash[22020]: cluster 2024-09-21T05:05:10.503239+0000 mgr.y (mgr.14385) 214 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:13 smithi089 bash[19831]: cluster 2024-09-21T05:05:12.504899+0000 mgr.y (mgr.14385) 215 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:14.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:13 smithi089 bash[26514]: cluster 2024-09-21T05:05:12.504899+0000 mgr.y (mgr.14385) 215 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:13 smithi110 bash[22020]: cluster 2024-09-21T05:05:12.504899+0000 mgr.y (mgr.14385) 215 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[26514]: audit 2024-09-21T05:05:13.789819+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:15.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[26514]: audit 2024-09-21T05:05:13.791365+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:15.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[26514]: audit 2024-09-21T05:05:13.799702+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:05:15.063 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[19831]: audit 2024-09-21T05:05:13.789819+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:15.063 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[19831]: audit 2024-09-21T05:05:13.791365+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:15.063 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:14 smithi089 bash[19831]: audit 2024-09-21T05:05:13.799702+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:05:15.064 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:14 smithi110 bash[22020]: audit 2024-09-21T05:05:13.789819+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:05:15.064 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:14 smithi110 bash[22020]: audit 2024-09-21T05:05:13.791365+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:05:15.064 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:14 smithi110 bash[22020]: audit 2024-09-21T05:05:13.799702+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:05:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:15 smithi089 bash[26514]: cluster 2024-09-21T05:05:14.505654+0000 mgr.y (mgr.14385) 216 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:16.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:15 smithi089 bash[19831]: cluster 2024-09-21T05:05:14.505654+0000 mgr.y (mgr.14385) 216 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:15 smithi110 bash[22020]: cluster 2024-09-21T05:05:14.505654+0000 mgr.y (mgr.14385) 216 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:17.966 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:17 smithi089 bash[19831]: cluster 2024-09-21T05:05:16.507280+0000 mgr.y (mgr.14385) 217 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:17.967 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:17 smithi089 bash[26514]: cluster 2024-09-21T05:05:16.507280+0000 mgr.y (mgr.14385) 217 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:17 smithi110 bash[22020]: cluster 2024-09-21T05:05:16.507280+0000 mgr.y (mgr.14385) 217 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:19 smithi089 bash[19831]: audit 2024-09-21T05:05:17.968672+0000 mgr.y (mgr.14385) 218 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:19 smithi089 bash[19831]: cluster 2024-09-21T05:05:18.508093+0000 mgr.y (mgr.14385) 219 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:20.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:19 smithi089 bash[26514]: audit 2024-09-21T05:05:17.968672+0000 mgr.y (mgr.14385) 218 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:20.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:19 smithi089 bash[26514]: cluster 2024-09-21T05:05:18.508093+0000 mgr.y (mgr.14385) 219 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:19 smithi110 bash[22020]: audit 2024-09-21T05:05:17.968672+0000 mgr.y (mgr.14385) 218 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:19 smithi110 bash[22020]: cluster 2024-09-21T05:05:18.508093+0000 mgr.y (mgr.14385) 219 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:22.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:21 smithi089 bash[19831]: cluster 2024-09-21T05:05:20.508822+0000 mgr.y (mgr.14385) 220 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:22.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:21] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:05:22.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:21 smithi089 bash[26514]: cluster 2024-09-21T05:05:20.508822+0000 mgr.y (mgr.14385) 220 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:21 smithi110 bash[22020]: cluster 2024-09-21T05:05:20.508822+0000 mgr.y (mgr.14385) 220 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:24.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:23 smithi089 bash[19831]: cluster 2024-09-21T05:05:22.510531+0000 mgr.y (mgr.14385) 221 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:24.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:23 smithi089 bash[26514]: cluster 2024-09-21T05:05:22.510531+0000 mgr.y (mgr.14385) 221 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:23 smithi110 bash[22020]: cluster 2024-09-21T05:05:22.510531+0000 mgr.y (mgr.14385) 221 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:25 smithi089 bash[19831]: cluster 2024-09-21T05:05:24.511332+0000 mgr.y (mgr.14385) 222 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:25 smithi089 bash[19831]: audit 2024-09-21T05:05:25.509513+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:26.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:25 smithi089 bash[26514]: cluster 2024-09-21T05:05:24.511332+0000 mgr.y (mgr.14385) 222 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:26.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:25 smithi089 bash[26514]: audit 2024-09-21T05:05:25.509513+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:25 smithi110 bash[22020]: cluster 2024-09-21T05:05:24.511332+0000 mgr.y (mgr.14385) 222 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:25 smithi110 bash[22020]: audit 2024-09-21T05:05:25.509513+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:27.977 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:27 smithi089 bash[19831]: cluster 2024-09-21T05:05:26.513023+0000 mgr.y (mgr.14385) 223 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:27.978 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:27 smithi089 bash[26514]: cluster 2024-09-21T05:05:26.513023+0000 mgr.y (mgr.14385) 223 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:27 smithi110 bash[22020]: cluster 2024-09-21T05:05:26.513023+0000 mgr.y (mgr.14385) 223 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:30.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:29 smithi089 bash[19831]: audit 2024-09-21T05:05:27.979900+0000 mgr.y (mgr.14385) 224 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:30.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:29 smithi089 bash[19831]: cluster 2024-09-21T05:05:28.513827+0000 mgr.y (mgr.14385) 225 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:30.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:29 smithi089 bash[26514]: audit 2024-09-21T05:05:27.979900+0000 mgr.y (mgr.14385) 224 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:30.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:29 smithi089 bash[26514]: cluster 2024-09-21T05:05:28.513827+0000 mgr.y (mgr.14385) 225 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:29 smithi110 bash[22020]: audit 2024-09-21T05:05:27.979900+0000 mgr.y (mgr.14385) 224 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:29 smithi110 bash[22020]: cluster 2024-09-21T05:05:28.513827+0000 mgr.y (mgr.14385) 225 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:32.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:31] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:05:32.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:31 smithi089 bash[19831]: cluster 2024-09-21T05:05:30.514482+0000 mgr.y (mgr.14385) 226 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:32.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:31 smithi089 bash[26514]: cluster 2024-09-21T05:05:30.514482+0000 mgr.y (mgr.14385) 226 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:31 smithi110 bash[22020]: cluster 2024-09-21T05:05:30.514482+0000 mgr.y (mgr.14385) 226 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:34.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:33 smithi089 bash[19831]: cluster 2024-09-21T05:05:32.516186+0000 mgr.y (mgr.14385) 227 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:34.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:33 smithi089 bash[26514]: cluster 2024-09-21T05:05:32.516186+0000 mgr.y (mgr.14385) 227 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:33 smithi110 bash[22020]: cluster 2024-09-21T05:05:32.516186+0000 mgr.y (mgr.14385) 227 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:36.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:35 smithi089 bash[19831]: cluster 2024-09-21T05:05:34.516911+0000 mgr.y (mgr.14385) 228 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:36.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:35 smithi089 bash[26514]: cluster 2024-09-21T05:05:34.516911+0000 mgr.y (mgr.14385) 228 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:35 smithi110 bash[22020]: cluster 2024-09-21T05:05:34.516911+0000 mgr.y (mgr.14385) 228 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:37.988 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:37 smithi089 bash[19831]: cluster 2024-09-21T05:05:36.518504+0000 mgr.y (mgr.14385) 229 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:37.988 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:37 smithi089 bash[26514]: cluster 2024-09-21T05:05:36.518504+0000 mgr.y (mgr.14385) 229 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:37 smithi110 bash[22020]: cluster 2024-09-21T05:05:36.518504+0000 mgr.y (mgr.14385) 229 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:40.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:39 smithi089 bash[19831]: audit 2024-09-21T05:05:37.990241+0000 mgr.y (mgr.14385) 230 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:40.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:39 smithi089 bash[19831]: cluster 2024-09-21T05:05:38.519180+0000 mgr.y (mgr.14385) 231 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:40.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:39 smithi089 bash[26514]: audit 2024-09-21T05:05:37.990241+0000 mgr.y (mgr.14385) 230 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:40.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:39 smithi089 bash[26514]: cluster 2024-09-21T05:05:38.519180+0000 mgr.y (mgr.14385) 231 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:39 smithi110 bash[22020]: audit 2024-09-21T05:05:37.990241+0000 mgr.y (mgr.14385) 230 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:39 smithi110 bash[22020]: cluster 2024-09-21T05:05:38.519180+0000 mgr.y (mgr.14385) 231 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:41.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:40 smithi089 bash[19831]: audit 2024-09-21T05:05:40.509907+0000 mon.c (mon.2) 125 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:41.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:40 smithi089 bash[26514]: audit 2024-09-21T05:05:40.509907+0000 mon.c (mon.2) 125 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:40 smithi110 bash[22020]: audit 2024-09-21T05:05:40.509907+0000 mon.c (mon.2) 125 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:42.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:41 smithi089 bash[19831]: cluster 2024-09-21T05:05:40.519849+0000 mgr.y (mgr.14385) 232 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:42.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:41] "GET /metrics HTTP/1.1" 200 38154 "" "Prometheus/2.43.0" 2024-09-21T05:05:42.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:41 smithi089 bash[26514]: cluster 2024-09-21T05:05:40.519849+0000 mgr.y (mgr.14385) 232 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:41 smithi110 bash[22020]: cluster 2024-09-21T05:05:40.519849+0000 mgr.y (mgr.14385) 232 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:44.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:43 smithi089 bash[19831]: cluster 2024-09-21T05:05:42.521485+0000 mgr.y (mgr.14385) 233 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:44.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:43 smithi089 bash[26514]: cluster 2024-09-21T05:05:42.521485+0000 mgr.y (mgr.14385) 233 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:43 smithi110 bash[22020]: cluster 2024-09-21T05:05:42.521485+0000 mgr.y (mgr.14385) 233 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:46.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:45 smithi089 bash[19831]: cluster 2024-09-21T05:05:44.522152+0000 mgr.y (mgr.14385) 234 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:46.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:45 smithi089 bash[26514]: cluster 2024-09-21T05:05:44.522152+0000 mgr.y (mgr.14385) 234 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:45 smithi110 bash[22020]: cluster 2024-09-21T05:05:44.522152+0000 mgr.y (mgr.14385) 234 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:47.996 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:47 smithi089 bash[19831]: cluster 2024-09-21T05:05:46.523737+0000 mgr.y (mgr.14385) 235 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:47.996 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:47 smithi089 bash[26514]: cluster 2024-09-21T05:05:46.523737+0000 mgr.y (mgr.14385) 235 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:47 smithi110 bash[22020]: cluster 2024-09-21T05:05:46.523737+0000 mgr.y (mgr.14385) 235 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:50.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:49 smithi089 bash[19831]: audit 2024-09-21T05:05:47.998270+0000 mgr.y (mgr.14385) 236 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:50.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:49 smithi089 bash[19831]: cluster 2024-09-21T05:05:48.524451+0000 mgr.y (mgr.14385) 237 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:50.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:49 smithi089 bash[26514]: audit 2024-09-21T05:05:47.998270+0000 mgr.y (mgr.14385) 236 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:50.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:49 smithi089 bash[26514]: cluster 2024-09-21T05:05:48.524451+0000 mgr.y (mgr.14385) 237 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:49 smithi110 bash[22020]: audit 2024-09-21T05:05:47.998270+0000 mgr.y (mgr.14385) 236 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:05:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:49 smithi110 bash[22020]: cluster 2024-09-21T05:05:48.524451+0000 mgr.y (mgr.14385) 237 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:51.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:50 smithi089 bash[19831]: cluster 2024-09-21T05:05:50.525142+0000 mgr.y (mgr.14385) 238 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:51.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:50 smithi089 bash[26514]: cluster 2024-09-21T05:05:50.525142+0000 mgr.y (mgr.14385) 238 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:50 smithi110 bash[22020]: cluster 2024-09-21T05:05:50.525142+0000 mgr.y (mgr.14385) 238 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:52.294 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:05:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:05:51] "GET /metrics HTTP/1.1" 200 38154 "" "Prometheus/2.43.0" 2024-09-21T05:05:54.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:53 smithi089 bash[19831]: cluster 2024-09-21T05:05:52.526829+0000 mgr.y (mgr.14385) 239 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:54.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:53 smithi089 bash[26514]: cluster 2024-09-21T05:05:52.526829+0000 mgr.y (mgr.14385) 239 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:53 smithi110 bash[22020]: cluster 2024-09-21T05:05:52.526829+0000 mgr.y (mgr.14385) 239 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:56.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:55 smithi089 bash[19831]: cluster 2024-09-21T05:05:54.527546+0000 mgr.y (mgr.14385) 240 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:56.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:55 smithi089 bash[19831]: audit 2024-09-21T05:05:55.510551+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:56.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:55 smithi089 bash[26514]: cluster 2024-09-21T05:05:54.527546+0000 mgr.y (mgr.14385) 240 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:56.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:55 smithi089 bash[26514]: audit 2024-09-21T05:05:55.510551+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:55 smithi110 bash[22020]: cluster 2024-09-21T05:05:54.527546+0000 mgr.y (mgr.14385) 240 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:05:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:55 smithi110 bash[22020]: audit 2024-09-21T05:05:55.510551+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:05:58.005 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:57 smithi089 bash[19831]: cluster 2024-09-21T05:05:56.529130+0000 mgr.y (mgr.14385) 241 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:58.006 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:57 smithi089 bash[26514]: cluster 2024-09-21T05:05:56.529130+0000 mgr.y (mgr.14385) 241 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:05:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:57 smithi110 bash[22020]: cluster 2024-09-21T05:05:56.529130+0000 mgr.y (mgr.14385) 241 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:00.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:59 smithi089 bash[19831]: audit 2024-09-21T05:05:58.007862+0000 mgr.y (mgr.14385) 242 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:00.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:05:59 smithi089 bash[19831]: cluster 2024-09-21T05:05:58.529863+0000 mgr.y (mgr.14385) 243 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:00.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:59 smithi089 bash[26514]: audit 2024-09-21T05:05:58.007862+0000 mgr.y (mgr.14385) 242 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:00.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:05:59 smithi089 bash[26514]: cluster 2024-09-21T05:05:58.529863+0000 mgr.y (mgr.14385) 243 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:59 smithi110 bash[22020]: audit 2024-09-21T05:05:58.007862+0000 mgr.y (mgr.14385) 242 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:05:59 smithi110 bash[22020]: cluster 2024-09-21T05:05:58.529863+0000 mgr.y (mgr.14385) 243 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:02.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:01] "GET /metrics HTTP/1.1" 200 38155 "" "Prometheus/2.43.0" 2024-09-21T05:06:02.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:01 smithi089 bash[19831]: cluster 2024-09-21T05:06:00.530566+0000 mgr.y (mgr.14385) 244 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:02.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:01 smithi089 bash[26514]: cluster 2024-09-21T05:06:00.530566+0000 mgr.y (mgr.14385) 244 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:01 smithi110 bash[22020]: cluster 2024-09-21T05:06:00.530566+0000 mgr.y (mgr.14385) 244 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:04.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:03 smithi089 bash[19831]: cluster 2024-09-21T05:06:02.532338+0000 mgr.y (mgr.14385) 245 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:04.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:03 smithi089 bash[26514]: cluster 2024-09-21T05:06:02.532338+0000 mgr.y (mgr.14385) 245 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:03 smithi110 bash[22020]: cluster 2024-09-21T05:06:02.532338+0000 mgr.y (mgr.14385) 245 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:05 smithi089 bash[19831]: cluster 2024-09-21T05:06:04.533148+0000 mgr.y (mgr.14385) 246 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:06.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:05 smithi089 bash[26514]: cluster 2024-09-21T05:06:04.533148+0000 mgr.y (mgr.14385) 246 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:05 smithi110 bash[22020]: cluster 2024-09-21T05:06:04.533148+0000 mgr.y (mgr.14385) 246 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:08.015 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:07 smithi089 bash[19831]: cluster 2024-09-21T05:06:06.534917+0000 mgr.y (mgr.14385) 247 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:08.016 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:07 smithi089 bash[26514]: cluster 2024-09-21T05:06:06.534917+0000 mgr.y (mgr.14385) 247 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:07 smithi110 bash[22020]: cluster 2024-09-21T05:06:06.534917+0000 mgr.y (mgr.14385) 247 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:09.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:09 smithi089 bash[26514]: audit 2024-09-21T05:06:08.018193+0000 mgr.y (mgr.14385) 248 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:09.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:09 smithi089 bash[26514]: cluster 2024-09-21T05:06:08.535751+0000 mgr.y (mgr.14385) 249 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:09.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:09 smithi089 bash[19831]: audit 2024-09-21T05:06:08.018193+0000 mgr.y (mgr.14385) 248 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:09.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:09 smithi089 bash[19831]: cluster 2024-09-21T05:06:08.535751+0000 mgr.y (mgr.14385) 249 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:09.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T05:06:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:09 smithi110 bash[22020]: audit 2024-09-21T05:06:08.018193+0000 mgr.y (mgr.14385) 248 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:09 smithi110 bash[22020]: cluster 2024-09-21T05:06:08.535751+0000 mgr.y (mgr.14385) 249 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:11.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:10 smithi089 bash[19831]: audit 2024-09-21T05:06:10.510608+0000 mon.c (mon.2) 127 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:11.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:10 smithi089 bash[26514]: audit 2024-09-21T05:06:10.510608+0000 mon.c (mon.2) 127 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:10 smithi110 bash[22020]: audit 2024-09-21T05:06:10.510608+0000 mon.c (mon.2) 127 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:12.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:11 smithi089 bash[19831]: cluster 2024-09-21T05:06:10.542790+0000 mgr.y (mgr.14385) 250 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:12.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:11] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:06:12.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:11 smithi089 bash[26514]: cluster 2024-09-21T05:06:10.542790+0000 mgr.y (mgr.14385) 250 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:11 smithi110 bash[22020]: cluster 2024-09-21T05:06:10.542790+0000 mgr.y (mgr.14385) 250 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:13 smithi089 bash[19831]: cluster 2024-09-21T05:06:12.544530+0000 mgr.y (mgr.14385) 251 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:14.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:13 smithi089 bash[26514]: cluster 2024-09-21T05:06:12.544530+0000 mgr.y (mgr.14385) 251 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:13 smithi110 bash[22020]: cluster 2024-09-21T05:06:12.544530+0000 mgr.y (mgr.14385) 251 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:14.752 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:14.949 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[19831]: audit 2024-09-21T05:06:14.593779+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:14.949 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[19831]: audit 2024-09-21T05:06:14.594972+0000 mon.c (mon.2) 129 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:14.949 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[19831]: audit 2024-09-21T05:06:14.603479+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:06:14.950 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[26514]: audit 2024-09-21T05:06:14.593779+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:14.950 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[26514]: audit 2024-09-21T05:06:14.594972+0000 mon.c (mon.2) 129 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:14.950 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:14 smithi089 bash[26514]: audit 2024-09-21T05:06:14.603479+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:06:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:14 smithi110 bash[22020]: audit 2024-09-21T05:06:14.593779+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:06:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:14 smithi110 bash[22020]: audit 2024-09-21T05:06:14.594972+0000 mon.c (mon.2) 129 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:06:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:14 smithi110 bash[22020]: audit 2024-09-21T05:06:14.603479+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:06:16.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:15 smithi089 bash[19831]: cluster 2024-09-21T05:06:14.544927+0000 mgr.y (mgr.14385) 252 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:15 smithi089 bash[26514]: cluster 2024-09-21T05:06:14.544927+0000 mgr.y (mgr.14385) 252 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:15 smithi110 bash[22020]: cluster 2024-09-21T05:06:14.544927+0000 mgr.y (mgr.14385) 252 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:16.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T05:06:18.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:17 smithi089 bash[19831]: cluster 2024-09-21T05:06:16.546643+0000 mgr.y (mgr.14385) 253 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:18.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:17 smithi089 bash[26514]: cluster 2024-09-21T05:06:16.546643+0000 mgr.y (mgr.14385) 253 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:17 smithi110 bash[22020]: cluster 2024-09-21T05:06:16.546643+0000 mgr.y (mgr.14385) 253 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:19 smithi089 bash[19831]: audit 2024-09-21T05:06:18.029478+0000 mgr.y (mgr.14385) 254 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:19 smithi089 bash[19831]: cluster 2024-09-21T05:06:18.547471+0000 mgr.y (mgr.14385) 255 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:20.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:19 smithi089 bash[26514]: audit 2024-09-21T05:06:18.029478+0000 mgr.y (mgr.14385) 254 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:20.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:19 smithi089 bash[26514]: cluster 2024-09-21T05:06:18.547471+0000 mgr.y (mgr.14385) 255 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:19 smithi110 bash[22020]: audit 2024-09-21T05:06:18.029478+0000 mgr.y (mgr.14385) 254 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:19 smithi110 bash[22020]: cluster 2024-09-21T05:06:18.547471+0000 mgr.y (mgr.14385) 255 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:21 smithi089 bash[19831]: cluster 2024-09-21T05:06:20.548215+0000 mgr.y (mgr.14385) 256 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:22.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:21] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:06:22.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:21 smithi089 bash[26514]: cluster 2024-09-21T05:06:20.548215+0000 mgr.y (mgr.14385) 256 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:21 smithi110 bash[22020]: cluster 2024-09-21T05:06:20.548215+0000 mgr.y (mgr.14385) 256 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:23.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T05:06:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:23 smithi089 bash[19831]: cluster 2024-09-21T05:06:22.549948+0000 mgr.y (mgr.14385) 257 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:24.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:23 smithi089 bash[26514]: cluster 2024-09-21T05:06:22.549948+0000 mgr.y (mgr.14385) 257 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:23 smithi110 bash[22020]: cluster 2024-09-21T05:06:22.549948+0000 mgr.y (mgr.14385) 257 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:25 smithi089 bash[19831]: cluster 2024-09-21T05:06:24.550684+0000 mgr.y (mgr.14385) 258 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:25 smithi089 bash[19831]: audit 2024-09-21T05:06:25.510879+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:26.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:25 smithi089 bash[26514]: cluster 2024-09-21T05:06:24.550684+0000 mgr.y (mgr.14385) 258 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:26.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:25 smithi089 bash[26514]: audit 2024-09-21T05:06:25.510879+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:25 smithi110 bash[22020]: cluster 2024-09-21T05:06:24.550684+0000 mgr.y (mgr.14385) 258 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:25 smithi110 bash[22020]: audit 2024-09-21T05:06:25.510879+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:28.038 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:27 smithi089 bash[19831]: cluster 2024-09-21T05:06:26.552324+0000 mgr.y (mgr.14385) 259 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:28.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:27 smithi089 bash[26514]: cluster 2024-09-21T05:06:26.552324+0000 mgr.y (mgr.14385) 259 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:27 smithi110 bash[22020]: cluster 2024-09-21T05:06:26.552324+0000 mgr.y (mgr.14385) 259 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:28.459 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:29.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:29 smithi089 bash[19831]: audit 2024-09-21T05:06:28.040575+0000 mgr.y (mgr.14385) 260 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:29.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:29 smithi089 bash[19831]: cluster 2024-09-21T05:06:28.553022+0000 mgr.y (mgr.14385) 261 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:29.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:29 smithi089 bash[26514]: audit 2024-09-21T05:06:28.040575+0000 mgr.y (mgr.14385) 260 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:29.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:29 smithi089 bash[26514]: cluster 2024-09-21T05:06:28.553022+0000 mgr.y (mgr.14385) 261 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:29 smithi110 bash[22020]: audit 2024-09-21T05:06:28.040575+0000 mgr.y (mgr.14385) 260 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:29 smithi110 bash[22020]: cluster 2024-09-21T05:06:28.553022+0000 mgr.y (mgr.14385) 261 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:30.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:06:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:31 smithi089 bash[19831]: cluster 2024-09-21T05:06:30.553761+0000 mgr.y (mgr.14385) 262 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:32.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:31] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.43.0" 2024-09-21T05:06:32.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:31 smithi089 bash[26514]: cluster 2024-09-21T05:06:30.553761+0000 mgr.y (mgr.14385) 262 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:31 smithi110 bash[22020]: cluster 2024-09-21T05:06:30.553761+0000 mgr.y (mgr.14385) 262 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:33 smithi089 bash[19831]: cluster 2024-09-21T05:06:32.555480+0000 mgr.y (mgr.14385) 263 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:34.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:33 smithi089 bash[26514]: cluster 2024-09-21T05:06:32.555480+0000 mgr.y (mgr.14385) 263 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:33 smithi110 bash[22020]: cluster 2024-09-21T05:06:32.555480+0000 mgr.y (mgr.14385) 263 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:35.343 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:36.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:35 smithi089 bash[19831]: cluster 2024-09-21T05:06:34.556213+0000 mgr.y (mgr.14385) 264 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:36.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:35 smithi089 bash[26514]: cluster 2024-09-21T05:06:34.556213+0000 mgr.y (mgr.14385) 264 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:35 smithi110 bash[22020]: cluster 2024-09-21T05:06:34.556213+0000 mgr.y (mgr.14385) 264 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (5m) 3m ago 6m 14.1M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (5m) 3m ago 5m 73.9M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (3m) 3m ago 3m - - 3.8 164465d2334a 3b1e9d3a9a61 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,8765 running (14m) 3m ago 14m 427M - 19.1.1-373-g4e45e6b4 164465d2334a 2ccf76ec370c 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:9283,8765 running (16m) 3m ago 16m 491M - 19.1.1-373-g4e45e6b4 164465d2334a 326bedf203f9 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (16m) 3m ago 16m 47.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:06:36.822 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (14m) 3m ago 14m 39.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (14m) 3m ago 14m 40.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (6m) 3m ago 6m 7984k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (6m) 3m ago 6m 8320k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (13m) 3m ago 13m 49.6M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (12m) 3m ago 12m 58.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (11m) 3m ago 11m 54.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (10m) 3m ago 11m 46.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (10m) 3m ago 10m 60.8M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (9m) 3m ago 9m 45.2M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:06:36.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (8m) 3m ago 8m 53.7M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:06:36.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (7m) 3m ago 7m 54.1M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:06:36.824 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (5m) 3m ago 6m 37.5M - 2.43.0 a07b618ecd1d f1ada0c8105d 2024-09-21T05:06:36.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (3m) 3m ago 3m 89.8M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:06:36.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (3m) 3m ago 3m 89.7M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:06:37.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions' 2024-09-21T05:06:37.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:37 smithi089 bash[19831]: cluster 2024-09-21T05:06:36.557104+0000 mgr.y (mgr.14385) 265 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:37.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:37 smithi089 bash[26514]: cluster 2024-09-21T05:06:36.557104+0000 mgr.y (mgr.14385) 265 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:37 smithi110 bash[22020]: cluster 2024-09-21T05:06:36.557104+0000 mgr.y (mgr.14385) 265 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:39.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:38 smithi089 bash[19831]: audit 2024-09-21T05:06:36.787103+0000 mgr.y (mgr.14385) 266 : audit [DBG] from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:39.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:38 smithi089 bash[26514]: audit 2024-09-21T05:06:36.787103+0000 mgr.y (mgr.14385) 266 : audit [DBG] from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:38 smithi110 bash[22020]: audit 2024-09-21T05:06:36.787103+0000 mgr.y (mgr.14385) 266 : audit [DBG] from='client.24830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:40.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:39 smithi089 bash[19831]: audit 2024-09-21T05:06:38.050223+0000 mgr.y (mgr.14385) 267 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:40.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:39 smithi089 bash[19831]: cluster 2024-09-21T05:06:38.557775+0000 mgr.y (mgr.14385) 268 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:40.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:39 smithi089 bash[26514]: audit 2024-09-21T05:06:38.050223+0000 mgr.y (mgr.14385) 267 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:40.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:39 smithi089 bash[26514]: cluster 2024-09-21T05:06:38.557775+0000 mgr.y (mgr.14385) 268 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:39 smithi110 bash[22020]: audit 2024-09-21T05:06:38.050223+0000 mgr.y (mgr.14385) 267 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:39 smithi110 bash[22020]: cluster 2024-09-21T05:06:38.557775+0000 mgr.y (mgr.14385) 268 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:41.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:40 smithi089 bash[19831]: audit 2024-09-21T05:06:40.511424+0000 mon.c (mon.2) 131 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:41.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:40 smithi089 bash[26514]: audit 2024-09-21T05:06:40.511424+0000 mon.c (mon.2) 131 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:40 smithi110 bash[22020]: audit 2024-09-21T05:06:40.511424+0000 mon.c (mon.2) 131 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:42.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:41 smithi089 bash[19831]: cluster 2024-09-21T05:06:40.558392+0000 mgr.y (mgr.14385) 269 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:42.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:41] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:06:42.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:41 smithi089 bash[26514]: cluster 2024-09-21T05:06:40.558392+0000 mgr.y (mgr.14385) 269 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:41 smithi110 bash[22020]: cluster 2024-09-21T05:06:40.558392+0000 mgr.y (mgr.14385) 269 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:42.341 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:43.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:42 smithi089 bash[19831]: cluster 2024-09-21T05:06:42.560034+0000 mgr.y (mgr.14385) 270 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:43.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:42 smithi089 bash[26514]: cluster 2024-09-21T05:06:42.560034+0000 mgr.y (mgr.14385) 270 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:42 smithi110 bash[22020]: cluster 2024-09-21T05:06:42.560034+0000 mgr.y (mgr.14385) 270 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:43.748 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:06:43.748 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 15 2024-09-21T05:06:43.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:06:43.750 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:06:44.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:43 smithi089 bash[19831]: audit 2024-09-21T05:06:43.751752+0000 mon.a (mon.0) 892 : audit [DBG] from='client.? 172.21.15.89:0/4089594049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:06:44.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:43 smithi089 bash[26514]: audit 2024-09-21T05:06:43.751752+0000 mon.a (mon.0) 892 : audit [DBG] from='client.? 172.21.15.89:0/4089594049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:06:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:43 smithi110 bash[22020]: audit 2024-09-21T05:06:43.751752+0000 mon.a (mon.0) 892 : audit [DBG] from='client.? 172.21.15.89:0/4089594049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:06:44.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph -s' 2024-09-21T05:06:45.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:44 smithi089 bash[19831]: cluster 2024-09-21T05:06:44.560687+0000 mgr.y (mgr.14385) 271 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:45.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:44 smithi089 bash[26514]: cluster 2024-09-21T05:06:44.560687+0000 mgr.y (mgr.14385) 271 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:45.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:44 smithi110 bash[22020]: cluster 2024-09-21T05:06:44.560687+0000 mgr.y (mgr.14385) 271 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:47 smithi089 bash[19831]: cluster 2024-09-21T05:06:46.562295+0000 mgr.y (mgr.14385) 272 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:48.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:47 smithi089 bash[26514]: cluster 2024-09-21T05:06:46.562295+0000 mgr.y (mgr.14385) 272 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:47 smithi110 bash[22020]: cluster 2024-09-21T05:06:46.562295+0000 mgr.y (mgr.14385) 272 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:49.253 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:49 smithi089 bash[19831]: audit 2024-09-21T05:06:48.058180+0000 mgr.y (mgr.14385) 273 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:49 smithi089 bash[19831]: cluster 2024-09-21T05:06:48.562997+0000 mgr.y (mgr.14385) 274 : cluster [DBG] pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:50.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:49 smithi089 bash[26514]: audit 2024-09-21T05:06:48.058180+0000 mgr.y (mgr.14385) 273 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:50.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:49 smithi089 bash[26514]: cluster 2024-09-21T05:06:48.562997+0000 mgr.y (mgr.14385) 274 : cluster [DBG] pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:49 smithi110 bash[22020]: audit 2024-09-21T05:06:48.058180+0000 mgr.y (mgr.14385) 273 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:06:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:49 smithi110 bash[22020]: cluster 2024-09-21T05:06:48.562997+0000 mgr.y (mgr.14385) 274 : cluster [DBG] pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: cluster: 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: id: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: health: HEALTH_OK 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: services: 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: mon: 3 daemons, quorum a,b,c (age 14m) 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: mgr: y(active, since 6m), standbys: x 2024-09-21T05:06:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: osd: 8 osds: 8 up (since 7m), 8 in (since 7m) 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: data: 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: pools: 6 pools, 161 pgs 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: objects: 244 objects, 585 KiB 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: usage: 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: pgs: 161 active+clean 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: io: 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: client: 852 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-21T05:06:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:06:51.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ls' 2024-09-21T05:06:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:51 smithi089 bash[19831]: cluster 2024-09-21T05:06:50.563415+0000 mgr.y (mgr.14385) 275 : cluster [DBG] pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:51.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:51 smithi089 bash[19831]: audit 2024-09-21T05:06:50.788627+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.89:0/70682779' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:06:51.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:51 smithi089 bash[26514]: cluster 2024-09-21T05:06:50.563415+0000 mgr.y (mgr.14385) 275 : cluster [DBG] pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:51.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:51 smithi089 bash[26514]: audit 2024-09-21T05:06:50.788627+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.89:0/70682779' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:06:52.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:06:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:06:51] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:06:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:51 smithi110 bash[22020]: cluster 2024-09-21T05:06:50.563415+0000 mgr.y (mgr.14385) 275 : cluster [DBG] pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:51 smithi110 bash[22020]: audit 2024-09-21T05:06:50.788627+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.89:0/70682779' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:06:54.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:53 smithi089 bash[19831]: cluster 2024-09-21T05:06:52.565053+0000 mgr.y (mgr.14385) 276 : cluster [DBG] pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:54.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:53 smithi089 bash[26514]: cluster 2024-09-21T05:06:52.565053+0000 mgr.y (mgr.14385) 276 : cluster [DBG] pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:53 smithi110 bash[22020]: cluster 2024-09-21T05:06:52.565053+0000 mgr.y (mgr.14385) 276 : cluster [DBG] pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:56.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:55 smithi089 bash[19831]: cluster 2024-09-21T05:06:54.565787+0000 mgr.y (mgr.14385) 277 : cluster [DBG] pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:56.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:55 smithi089 bash[19831]: audit 2024-09-21T05:06:55.511847+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:56.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:55 smithi089 bash[26514]: cluster 2024-09-21T05:06:54.565787+0000 mgr.y (mgr.14385) 277 : cluster [DBG] pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:56.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:55 smithi089 bash[26514]: audit 2024-09-21T05:06:55.511847+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:55 smithi110 bash[22020]: cluster 2024-09-21T05:06:54.565787+0000 mgr.y (mgr.14385) 277 : cluster [DBG] pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:06:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:55 smithi110 bash[22020]: audit 2024-09-21T05:06:55.511847+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:06:56.248 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:06:57.674 INFO:teuthology.orchestra.run.smithi089.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager ?:9093,9094 1/1 3m ago 6m smithi089=a;count:1 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:grafana ?:3000 1/1 4m ago 6m smithi110=a;count:1 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo ?:5000 1/1 3m ago 3m count:1 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:mgr 2/2 4m ago 14m smithi089=y;smithi110=x;count:2 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:mon 3/3 4m ago 15m smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b;count:3 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter ?:9100 2/2 4m ago 7m smithi089=a;smithi110=b;count:2 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:osd 8 4m ago - 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus ?:9095 1/1 4m ago 7m smithi110=a;count:1 2024-09-21T05:06:57.675 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo ?:8000 2/2 4m ago 4m count:2 2024-09-21T05:06:58.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:57 smithi089 bash[19831]: cluster 2024-09-21T05:06:56.567338+0000 mgr.y (mgr.14385) 278 : cluster [DBG] pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:57 smithi089 bash[26514]: cluster 2024-09-21T05:06:56.567338+0000 mgr.y (mgr.14385) 278 : cluster [DBG] pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:57 smithi110 bash[22020]: cluster 2024-09-21T05:06:56.567338+0000 mgr.y (mgr.14385) 278 : cluster [DBG] pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:06:58.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T05:06:59.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:58 smithi089 bash[19831]: audit 2024-09-21T05:06:57.663403+0000 mgr.y (mgr.14385) 279 : audit [DBG] from='client.14961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:59.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:58 smithi089 bash[26514]: audit 2024-09-21T05:06:57.663403+0000 mgr.y (mgr.14385) 279 : audit [DBG] from='client.14961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:06:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:58 smithi110 bash[22020]: audit 2024-09-21T05:06:57.663403+0000 mgr.y (mgr.14385) 279 : audit [DBG] from='client.14961 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:59 smithi089 bash[19831]: audit 2024-09-21T05:06:58.066160+0000 mgr.y (mgr.14385) 280 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:06:59 smithi089 bash[19831]: cluster 2024-09-21T05:06:58.567858+0000 mgr.y (mgr.14385) 281 : cluster [DBG] pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:00.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:59 smithi089 bash[26514]: audit 2024-09-21T05:06:58.066160+0000 mgr.y (mgr.14385) 280 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:00.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:06:59 smithi089 bash[26514]: cluster 2024-09-21T05:06:58.567858+0000 mgr.y (mgr.14385) 281 : cluster [DBG] pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:59 smithi110 bash[22020]: audit 2024-09-21T05:06:58.066160+0000 mgr.y (mgr.14385) 280 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:06:59 smithi110 bash[22020]: cluster 2024-09-21T05:06:58.567858+0000 mgr.y (mgr.14385) 281 : cluster [DBG] pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:02.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:01 smithi089 bash[19831]: cluster 2024-09-21T05:07:00.568487+0000 mgr.y (mgr.14385) 282 : cluster [DBG] pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:02.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:01] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:07:02.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:01 smithi089 bash[26514]: cluster 2024-09-21T05:07:00.568487+0000 mgr.y (mgr.14385) 282 : cluster [DBG] pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:01 smithi110 bash[22020]: cluster 2024-09-21T05:07:00.568487+0000 mgr.y (mgr.14385) 282 : cluster [DBG] pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:03.146 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:07:04.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:03 smithi089 bash[19831]: cluster 2024-09-21T05:07:02.570759+0000 mgr.y (mgr.14385) 283 : cluster [DBG] pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:04.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:03 smithi089 bash[26514]: cluster 2024-09-21T05:07:02.570759+0000 mgr.y (mgr.14385) 283 : cluster [DBG] pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:03 smithi110 bash[22020]: cluster 2024-09-21T05:07:02.570759+0000 mgr.y (mgr.14385) 283 : cluster [DBG] pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:05.025 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled to redeploy mgr.x on host 'smithi110' 2024-09-21T05:07:05.038 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:04 smithi089 bash[19831]: audit 2024-09-21T05:07:04.649315+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.89:0/2360853684' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:07:05.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:04 smithi089 bash[26514]: audit 2024-09-21T05:07:04.649315+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.89:0/2360853684' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:07:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:04 smithi110 bash[22020]: audit 2024-09-21T05:07:04.649315+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.15.89:0/2360853684' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:07:05.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps --refresh' 2024-09-21T05:07:06.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: cluster 2024-09-21T05:07:04.571457+0000 mgr.y (mgr.14385) 284 : cluster [DBG] pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.011353+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.019819+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.027819+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.030394+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.031480+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.040680+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.076767+0000 mon.c (mon.2) 135 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.077115+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.077996+0000 mon.c (mon.2) 136 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[19831]: audit 2024-09-21T05:07:05.078785+0000 mon.c (mon.2) 137 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:06.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: cluster 2024-09-21T05:07:04.571457+0000 mgr.y (mgr.14385) 284 : cluster [DBG] pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.011353+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.019819+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.027819+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.030394+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.031480+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.040680+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.076767+0000 mon.c (mon.2) 135 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.077115+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.077996+0000 mon.c (mon.2) 136 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:07:06.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:05 smithi089 bash[26514]: audit 2024-09-21T05:07:05.078785+0000 mon.c (mon.2) 137 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: cluster 2024-09-21T05:07:04.571457+0000 mgr.y (mgr.14385) 284 : cluster [DBG] pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.011353+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.019819+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.027819+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.030394+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.031480+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.040680+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.076767+0000 mon.c (mon.2) 135 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.077115+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14385 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.077996+0000 mon.c (mon.2) 136 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:07:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:05 smithi110 bash[22020]: audit 2024-09-21T05:07:05.078785+0000 mon.c (mon.2) 137 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:07:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[19831]: audit 2024-09-21T05:07:05.005811+0000 mgr.y (mgr.14385) 285 : audit [DBG] from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[19831]: cephadm 2024-09-21T05:07:05.013811+0000 mgr.y (mgr.14385) 286 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-09-21T05:07:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[19831]: cephadm 2024-09-21T05:07:05.079534+0000 mgr.y (mgr.14385) 287 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:07:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[26514]: audit 2024-09-21T05:07:05.005811+0000 mgr.y (mgr.14385) 285 : audit [DBG] from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[26514]: cephadm 2024-09-21T05:07:05.013811+0000 mgr.y (mgr.14385) 286 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-09-21T05:07:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:06 smithi089 bash[26514]: cephadm 2024-09-21T05:07:05.079534+0000 mgr.y (mgr.14385) 287 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:07:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:06 smithi110 bash[22020]: audit 2024-09-21T05:07:05.005811+0000 mgr.y (mgr.14385) 285 : audit [DBG] from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:06 smithi110 bash[22020]: cephadm 2024-09-21T05:07:05.013811+0000 mgr.y (mgr.14385) 286 : cephadm [INF] Schedule redeploy daemon mgr.x 2024-09-21T05:07:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:06 smithi110 bash[22020]: cephadm 2024-09-21T05:07:05.079534+0000 mgr.y (mgr.14385) 287 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:07:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:07 smithi089 bash[19831]: cluster 2024-09-21T05:07:06.573073+0000 mgr.y (mgr.14385) 288 : cluster [DBG] pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:07 smithi089 bash[26514]: cluster 2024-09-21T05:07:06.573073+0000 mgr.y (mgr.14385) 288 : cluster [DBG] pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:07 smithi110 bash[22020]: cluster 2024-09-21T05:07:06.573073+0000 mgr.y (mgr.14385) 288 : cluster [DBG] pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:09 smithi089 bash[19831]: audit 2024-09-21T05:07:08.077412+0000 mgr.y (mgr.14385) 289 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:09 smithi089 bash[19831]: cluster 2024-09-21T05:07:08.573860+0000 mgr.y (mgr.14385) 290 : cluster [DBG] pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:09 smithi089 bash[26514]: audit 2024-09-21T05:07:08.077412+0000 mgr.y (mgr.14385) 289 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:09 smithi089 bash[26514]: cluster 2024-09-21T05:07:08.573860+0000 mgr.y (mgr.14385) 290 : cluster [DBG] pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:09 smithi110 bash[22020]: audit 2024-09-21T05:07:08.077412+0000 mgr.y (mgr.14385) 289 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:09 smithi110 bash[22020]: cluster 2024-09-21T05:07:08.573860+0000 mgr.y (mgr.14385) 290 : cluster [DBG] pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:10.478 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:07:11.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:10 smithi089 bash[19831]: audit 2024-09-21T05:07:10.511822+0000 mon.c (mon.2) 138 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:11.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:10 smithi089 bash[26514]: audit 2024-09-21T05:07:10.511822+0000 mon.c (mon.2) 138 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:10 smithi110 bash[22020]: audit 2024-09-21T05:07:10.511822+0000 mon.c (mon.2) 138 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:11.941 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (6m) 4m ago 6m 14.1M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (6m) 4m ago 6m 73.9M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (4m) 4m ago 4m - - 3.8 164465d2334a 3b1e9d3a9a61 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,8765 running (15m) 4m ago 15m 427M - 19.1.1-373-g4e45e6b4 164465d2334a 2ccf76ec370c 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:9283,8765 running (17m) 4m ago 17m 491M - 19.1.1-373-g4e45e6b4 164465d2334a 326bedf203f9 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (17m) 4m ago 17m 47.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (15m) 4m ago 15m 39.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (15m) 4m ago 15m 40.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (6m) 4m ago 6m 7984k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (6m) 4m ago 6m 8320k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (14m) 4m ago 14m 49.6M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:07:11.942 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (13m) 4m ago 13m 58.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (12m) 4m ago 12m 54.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (11m) 4m ago 11m 46.9M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (10m) 4m ago 10m 60.8M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (9m) 4m ago 9m 45.2M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (8m) 4m ago 8m 53.7M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (7m) 4m ago 8m 54.1M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (6m) 4m ago 7m 37.5M - 2.43.0 a07b618ecd1d f1ada0c8105d 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (4m) 4m ago 4m 89.8M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:07:11.943 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (4m) 4m ago 4m 89.7M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:07:11.954 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:11 smithi089 bash[19831]: cluster 2024-09-21T05:07:10.574452+0000 mgr.y (mgr.14385) 291 : cluster [DBG] pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:11.954 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:11] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:07:11.954 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:11 smithi089 bash[26514]: cluster 2024-09-21T05:07:10.574452+0000 mgr.y (mgr.14385) 291 : cluster [DBG] pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:11 smithi110 bash[22020]: cluster 2024-09-21T05:07:10.574452+0000 mgr.y (mgr.14385) 291 : cluster [DBG] pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:12.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:07:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:13 smithi089 bash[19831]: audit 2024-09-21T05:07:11.927394+0000 mgr.y (mgr.14385) 292 : audit [DBG] from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:13 smithi089 bash[19831]: cluster 2024-09-21T05:07:12.576129+0000 mgr.y (mgr.14385) 293 : cluster [DBG] pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:13 smithi089 bash[26514]: audit 2024-09-21T05:07:11.927394+0000 mgr.y (mgr.14385) 292 : audit [DBG] from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:13 smithi089 bash[26514]: cluster 2024-09-21T05:07:12.576129+0000 mgr.y (mgr.14385) 293 : cluster [DBG] pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:13 smithi110 bash[22020]: audit 2024-09-21T05:07:11.927394+0000 mgr.y (mgr.14385) 292 : audit [DBG] from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:07:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:13 smithi110 bash[22020]: cluster 2024-09-21T05:07:12.576129+0000 mgr.y (mgr.14385) 293 : cluster [DBG] pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:14 smithi089 bash[19831]: cluster 2024-09-21T05:07:14.576868+0000 mgr.y (mgr.14385) 294 : cluster [DBG] pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:15.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:14 smithi089 bash[26514]: cluster 2024-09-21T05:07:14.576868+0000 mgr.y (mgr.14385) 294 : cluster [DBG] pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:14 smithi110 bash[22020]: cluster 2024-09-21T05:07:14.576868+0000 mgr.y (mgr.14385) 294 : cluster [DBG] pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:17.422 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:07:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:17 smithi089 bash[19831]: cluster 2024-09-21T05:07:16.578454+0000 mgr.y (mgr.14385) 295 : cluster [DBG] pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:17 smithi089 bash[26514]: cluster 2024-09-21T05:07:16.578454+0000 mgr.y (mgr.14385) 295 : cluster [DBG] pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:17 smithi110 bash[22020]: cluster 2024-09-21T05:07:16.578454+0000 mgr.y (mgr.14385) 295 : cluster [DBG] pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:19 smithi089 bash[26514]: audit 2024-09-21T05:07:18.086151+0000 mgr.y (mgr.14385) 296 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:19 smithi089 bash[26514]: cluster 2024-09-21T05:07:18.579297+0000 mgr.y (mgr.14385) 297 : cluster [DBG] pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:19 smithi089 bash[19831]: audit 2024-09-21T05:07:18.086151+0000 mgr.y (mgr.14385) 296 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:19 smithi089 bash[19831]: cluster 2024-09-21T05:07:18.579297+0000 mgr.y (mgr.14385) 297 : cluster [DBG] pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:19 smithi110 bash[22020]: audit 2024-09-21T05:07:18.086151+0000 mgr.y (mgr.14385) 296 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:19 smithi110 bash[22020]: cluster 2024-09-21T05:07:18.579297+0000 mgr.y (mgr.14385) 297 : cluster [DBG] pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:22.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:21] "GET /metrics HTTP/1.1" 200 38160 "" "Prometheus/2.43.0" 2024-09-21T05:07:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:21 smithi089 bash[26514]: cluster 2024-09-21T05:07:20.580010+0000 mgr.y (mgr.14385) 298 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:21 smithi089 bash[19831]: cluster 2024-09-21T05:07:20.580010+0000 mgr.y (mgr.14385) 298 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:21 smithi110 bash[22020]: cluster 2024-09-21T05:07:20.580010+0000 mgr.y (mgr.14385) 298 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:23 smithi089 bash[26514]: cluster 2024-09-21T05:07:22.581708+0000 mgr.y (mgr.14385) 299 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:23 smithi089 bash[19831]: cluster 2024-09-21T05:07:22.581708+0000 mgr.y (mgr.14385) 299 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:23 smithi110 bash[22020]: cluster 2024-09-21T05:07:22.581708+0000 mgr.y (mgr.14385) 299 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:25 smithi089 bash[26514]: cluster 2024-09-21T05:07:24.582402+0000 mgr.y (mgr.14385) 300 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:25 smithi089 bash[26514]: audit 2024-09-21T05:07:25.512557+0000 mon.c (mon.2) 139 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:25 smithi089 bash[19831]: cluster 2024-09-21T05:07:24.582402+0000 mgr.y (mgr.14385) 300 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:25 smithi089 bash[19831]: audit 2024-09-21T05:07:25.512557+0000 mon.c (mon.2) 139 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:25 smithi110 bash[22020]: cluster 2024-09-21T05:07:24.582402+0000 mgr.y (mgr.14385) 300 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:25 smithi110 bash[22020]: audit 2024-09-21T05:07:25.512557+0000 mon.c (mon.2) 139 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:27 smithi089 bash[19831]: cluster 2024-09-21T05:07:26.583979+0000 mgr.y (mgr.14385) 301 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:27 smithi089 bash[26514]: cluster 2024-09-21T05:07:26.583979+0000 mgr.y (mgr.14385) 301 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:27 smithi110 bash[22020]: cluster 2024-09-21T05:07:26.583979+0000 mgr.y (mgr.14385) 301 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:29 smithi089 bash[19831]: audit 2024-09-21T05:07:28.094130+0000 mgr.y (mgr.14385) 302 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:29 smithi089 bash[19831]: cluster 2024-09-21T05:07:28.584659+0000 mgr.y (mgr.14385) 303 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:29 smithi089 bash[26514]: audit 2024-09-21T05:07:28.094130+0000 mgr.y (mgr.14385) 302 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:29 smithi089 bash[26514]: cluster 2024-09-21T05:07:28.584659+0000 mgr.y (mgr.14385) 303 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:29 smithi110 bash[22020]: audit 2024-09-21T05:07:28.094130+0000 mgr.y (mgr.14385) 302 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:29 smithi110 bash[22020]: cluster 2024-09-21T05:07:28.584659+0000 mgr.y (mgr.14385) 303 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:31 smithi089 bash[19831]: cluster 2024-09-21T05:07:30.585349+0000 mgr.y (mgr.14385) 304 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:32.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:31] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.43.0" 2024-09-21T05:07:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:31 smithi089 bash[26514]: cluster 2024-09-21T05:07:30.585349+0000 mgr.y (mgr.14385) 304 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:31 smithi110 bash[22020]: cluster 2024-09-21T05:07:30.585349+0000 mgr.y (mgr.14385) 304 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:33 smithi089 bash[19831]: cluster 2024-09-21T05:07:32.587053+0000 mgr.y (mgr.14385) 305 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:33 smithi089 bash[26514]: cluster 2024-09-21T05:07:32.587053+0000 mgr.y (mgr.14385) 305 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:33 smithi110 bash[22020]: cluster 2024-09-21T05:07:32.587053+0000 mgr.y (mgr.14385) 305 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:36.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:35 smithi089 bash[19831]: cluster 2024-09-21T05:07:34.587735+0000 mgr.y (mgr.14385) 306 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:35 smithi089 bash[26514]: cluster 2024-09-21T05:07:34.587735+0000 mgr.y (mgr.14385) 306 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:35 smithi110 bash[22020]: cluster 2024-09-21T05:07:34.587735+0000 mgr.y (mgr.14385) 306 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:38.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:37 smithi089 bash[19831]: cluster 2024-09-21T05:07:36.589354+0000 mgr.y (mgr.14385) 307 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:37 smithi089 bash[26514]: cluster 2024-09-21T05:07:36.589354+0000 mgr.y (mgr.14385) 307 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:37 smithi110 bash[22020]: cluster 2024-09-21T05:07:36.589354+0000 mgr.y (mgr.14385) 307 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:40.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:39 smithi089 bash[19831]: audit 2024-09-21T05:07:38.105338+0000 mgr.y (mgr.14385) 308 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:40.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:39 smithi089 bash[19831]: cluster 2024-09-21T05:07:38.590049+0000 mgr.y (mgr.14385) 309 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:39 smithi089 bash[26514]: audit 2024-09-21T05:07:38.105338+0000 mgr.y (mgr.14385) 308 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:39 smithi089 bash[26514]: cluster 2024-09-21T05:07:38.590049+0000 mgr.y (mgr.14385) 309 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:39 smithi110 bash[22020]: audit 2024-09-21T05:07:38.105338+0000 mgr.y (mgr.14385) 308 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:39 smithi110 bash[22020]: cluster 2024-09-21T05:07:38.590049+0000 mgr.y (mgr.14385) 309 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:41.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:40 smithi089 bash[19831]: audit 2024-09-21T05:07:40.513075+0000 mon.c (mon.2) 140 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:41.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:40 smithi089 bash[26514]: audit 2024-09-21T05:07:40.513075+0000 mon.c (mon.2) 140 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:40 smithi110 bash[22020]: audit 2024-09-21T05:07:40.513075+0000 mon.c (mon.2) 140 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:42.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:41] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:07:42.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:41 smithi089 bash[19831]: cluster 2024-09-21T05:07:40.590717+0000 mgr.y (mgr.14385) 310 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:42.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:41 smithi089 bash[26514]: cluster 2024-09-21T05:07:40.590717+0000 mgr.y (mgr.14385) 310 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:41 smithi110 bash[22020]: cluster 2024-09-21T05:07:40.590717+0000 mgr.y (mgr.14385) 310 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:44.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:43 smithi089 bash[19831]: cluster 2024-09-21T05:07:42.592460+0000 mgr.y (mgr.14385) 311 : cluster [DBG] pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:44.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:43 smithi089 bash[26514]: cluster 2024-09-21T05:07:42.592460+0000 mgr.y (mgr.14385) 311 : cluster [DBG] pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:43 smithi110 bash[22020]: cluster 2024-09-21T05:07:42.592460+0000 mgr.y (mgr.14385) 311 : cluster [DBG] pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:46.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:45 smithi089 bash[19831]: cluster 2024-09-21T05:07:44.593279+0000 mgr.y (mgr.14385) 312 : cluster [DBG] pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:46.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:45 smithi089 bash[26514]: cluster 2024-09-21T05:07:44.593279+0000 mgr.y (mgr.14385) 312 : cluster [DBG] pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:45 smithi110 bash[22020]: cluster 2024-09-21T05:07:44.593279+0000 mgr.y (mgr.14385) 312 : cluster [DBG] pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:47 smithi089 bash[19831]: cluster 2024-09-21T05:07:46.594978+0000 mgr.y (mgr.14385) 313 : cluster [DBG] pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:47 smithi089 bash[26514]: cluster 2024-09-21T05:07:46.594978+0000 mgr.y (mgr.14385) 313 : cluster [DBG] pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:47 smithi110 bash[22020]: cluster 2024-09-21T05:07:46.594978+0000 mgr.y (mgr.14385) 313 : cluster [DBG] pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:49 smithi089 bash[19831]: audit 2024-09-21T05:07:48.115374+0000 mgr.y (mgr.14385) 314 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:49 smithi089 bash[19831]: cluster 2024-09-21T05:07:48.595665+0000 mgr.y (mgr.14385) 315 : cluster [DBG] pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:50.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:49 smithi089 bash[26514]: audit 2024-09-21T05:07:48.115374+0000 mgr.y (mgr.14385) 314 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:50.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:49 smithi089 bash[26514]: cluster 2024-09-21T05:07:48.595665+0000 mgr.y (mgr.14385) 315 : cluster [DBG] pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:49 smithi110 bash[22020]: audit 2024-09-21T05:07:48.115374+0000 mgr.y (mgr.14385) 314 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:07:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:49 smithi110 bash[22020]: cluster 2024-09-21T05:07:48.595665+0000 mgr.y (mgr.14385) 315 : cluster [DBG] pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:52.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:51 smithi089 bash[19831]: cluster 2024-09-21T05:07:50.596397+0000 mgr.y (mgr.14385) 316 : cluster [DBG] pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:52.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:07:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:07:51] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:07:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:51 smithi089 bash[26514]: cluster 2024-09-21T05:07:50.596397+0000 mgr.y (mgr.14385) 316 : cluster [DBG] pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:51 smithi110 bash[22020]: cluster 2024-09-21T05:07:50.596397+0000 mgr.y (mgr.14385) 316 : cluster [DBG] pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:54.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:53 smithi089 bash[19831]: cluster 2024-09-21T05:07:52.598157+0000 mgr.y (mgr.14385) 317 : cluster [DBG] pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:54.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:53 smithi089 bash[26514]: cluster 2024-09-21T05:07:52.598157+0000 mgr.y (mgr.14385) 317 : cluster [DBG] pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:53 smithi110 bash[22020]: cluster 2024-09-21T05:07:52.598157+0000 mgr.y (mgr.14385) 317 : cluster [DBG] pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:55.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:54 smithi089 bash[19831]: cluster 2024-09-21T05:07:54.598853+0000 mgr.y (mgr.14385) 318 : cluster [DBG] pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:55.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:54 smithi089 bash[26514]: cluster 2024-09-21T05:07:54.598853+0000 mgr.y (mgr.14385) 318 : cluster [DBG] pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:54 smithi110 bash[22020]: cluster 2024-09-21T05:07:54.598853+0000 mgr.y (mgr.14385) 318 : cluster [DBG] pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:07:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:55 smithi089 bash[19831]: audit 2024-09-21T05:07:55.513708+0000 mon.c (mon.2) 141 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:55 smithi089 bash[26514]: audit 2024-09-21T05:07:55.513708+0000 mon.c (mon.2) 141 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:55 smithi110 bash[22020]: audit 2024-09-21T05:07:55.513708+0000 mon.c (mon.2) 141 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:07:57.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:56 smithi089 bash[19831]: cluster 2024-09-21T05:07:56.600470+0000 mgr.y (mgr.14385) 319 : cluster [DBG] pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:57.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:56 smithi089 bash[26514]: cluster 2024-09-21T05:07:56.600470+0000 mgr.y (mgr.14385) 319 : cluster [DBG] pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:07:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:56 smithi110 bash[22020]: cluster 2024-09-21T05:07:56.600470+0000 mgr.y (mgr.14385) 319 : cluster [DBG] pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:59 smithi089 bash[19831]: audit 2024-09-21T05:07:58.126197+0000 mgr.y (mgr.14385) 320 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:07:59 smithi089 bash[19831]: cluster 2024-09-21T05:07:58.601174+0000 mgr.y (mgr.14385) 321 : cluster [DBG] pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:00.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:59 smithi089 bash[26514]: audit 2024-09-21T05:07:58.126197+0000 mgr.y (mgr.14385) 320 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:00.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:07:59 smithi089 bash[26514]: cluster 2024-09-21T05:07:58.601174+0000 mgr.y (mgr.14385) 321 : cluster [DBG] pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:59 smithi110 bash[22020]: audit 2024-09-21T05:07:58.126197+0000 mgr.y (mgr.14385) 320 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:07:59 smithi110 bash[22020]: cluster 2024-09-21T05:07:58.601174+0000 mgr.y (mgr.14385) 321 : cluster [DBG] pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:00.697 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.697 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.697 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.698 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.698 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.698 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.699 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.699 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:00.699 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:01.003 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:00 smithi110 systemd[1]: Stopping Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:08:01.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 bash[49926]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-x 2024-09-21T05:08:01.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 bash[49986]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-x 2024-09-21T05:08:01.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:08:01.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service: Failed with result 'exit-code'. 2024-09-21T05:08:01.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: Stopped Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:08:02.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:01 smithi089 bash[26514]: cluster 2024-09-21T05:08:00.601882+0000 mgr.y (mgr.14385) 322 : cluster [DBG] pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:02.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:01 smithi089 bash[19831]: cluster 2024-09-21T05:08:00.601882+0000 mgr.y (mgr.14385) 322 : cluster [DBG] pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:02.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:01] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:08:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:01 smithi110 bash[22020]: cluster 2024-09-21T05:08:00.601882+0000 mgr.y (mgr.14385) 322 : cluster [DBG] pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:02.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: Started Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:08:02.056 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:02.056 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:08:01 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[26514]: audit 2024-09-21T05:08:01.750129+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[26514]: audit 2024-09-21T05:08:01.762692+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[26514]: audit 2024-09-21T05:08:01.774188+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[26514]: audit 2024-09-21T05:08:01.786575+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[26514]: cluster 2024-09-21T05:08:02.603455+0000 mgr.y (mgr.14385) 323 : cluster [DBG] pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[19831]: audit 2024-09-21T05:08:01.750129+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[19831]: audit 2024-09-21T05:08:01.762692+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[19831]: audit 2024-09-21T05:08:01.774188+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[19831]: audit 2024-09-21T05:08:01.786575+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:02 smithi089 bash[19831]: cluster 2024-09-21T05:08:02.603455+0000 mgr.y (mgr.14385) 323 : cluster [DBG] pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[50043]: debug 2024-09-21T05:08:02.809+0000 7f2e5e231640 1 -- 172.21.15.110:0/2972074332 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623c6d4d0e0 con 0x5623c6d4f800 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[22020]: audit 2024-09-21T05:08:01.750129+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[22020]: audit 2024-09-21T05:08:01.762692+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[22020]: audit 2024-09-21T05:08:01.774188+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[22020]: audit 2024-09-21T05:08:01.786575+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:02 smithi110 bash[22020]: cluster 2024-09-21T05:08:02.603455+0000 mgr.y (mgr.14385) 323 : cluster [DBG] pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:06.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:05 smithi089 bash[19831]: cluster 2024-09-21T05:08:04.604206+0000 mgr.y (mgr.14385) 324 : cluster [DBG] pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:06.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:05 smithi089 bash[26514]: cluster 2024-09-21T05:08:04.604206+0000 mgr.y (mgr.14385) 324 : cluster [DBG] pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:05 smithi110 bash[22020]: cluster 2024-09-21T05:08:04.604206+0000 mgr.y (mgr.14385) 324 : cluster [DBG] pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:08.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[26514]: cluster 2024-09-21T05:08:06.605938+0000 mgr.y (mgr.14385) 325 : cluster [DBG] pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[26514]: audit 2024-09-21T05:08:07.650943+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[26514]: audit 2024-09-21T05:08:07.661961+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[19831]: cluster 2024-09-21T05:08:06.605938+0000 mgr.y (mgr.14385) 325 : cluster [DBG] pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[19831]: audit 2024-09-21T05:08:07.650943+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:07 smithi089 bash[19831]: audit 2024-09-21T05:08:07.661961+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:07 smithi110 bash[22020]: cluster 2024-09-21T05:08:06.605938+0000 mgr.y (mgr.14385) 325 : cluster [DBG] pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:07 smithi110 bash[22020]: audit 2024-09-21T05:08:07.650943+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:07 smithi110 bash[22020]: audit 2024-09-21T05:08:07.661961+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:07.899745+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:07.913925+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:08.134211+0000 mgr.y (mgr.14385) 326 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:08.557935+0000 mon.c (mon.2) 142 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:08.559461+0000 mon.c (mon.2) 143 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: audit 2024-09-21T05:08:08.566628+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[19831]: cluster 2024-09-21T05:08:08.606366+0000 mgr.y (mgr.14385) 327 : cluster [DBG] pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:09.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:07.899745+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:07.913925+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:08.134211+0000 mgr.y (mgr.14385) 326 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:08.557935+0000 mon.c (mon.2) 142 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:08.559461+0000 mon.c (mon.2) 143 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: audit 2024-09-21T05:08:08.566628+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:08 smithi089 bash[26514]: cluster 2024-09-21T05:08:08.606366+0000 mgr.y (mgr.14385) 327 : cluster [DBG] pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[50043]: [21/Sep/2024:05:08:08] ENGINE Bus STARTING 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[50043]: CherryPy Checker: 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[50043]: The Application mounted at '' has an empty config. 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[50043]: [21/Sep/2024:05:08:09] ENGINE Serving on http://:::9283 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[50043]: [21/Sep/2024:05:08:09] ENGINE Bus STARTED 2024-09-21T05:08:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:07.899745+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:07.913925+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:08.134211+0000 mgr.y (mgr.14385) 326 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:08.557935+0000 mon.c (mon.2) 142 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:08.559461+0000 mon.c (mon.2) 143 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: audit 2024-09-21T05:08:08.566628+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:08:09.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:08 smithi110 bash[22020]: cluster 2024-09-21T05:08:08.606366+0000 mgr.y (mgr.14385) 327 : cluster [DBG] pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: audit 2024-09-21T05:08:08.923885+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: audit 2024-09-21T05:08:08.924489+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: cluster 2024-09-21T05:08:08.925761+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: cluster 2024-09-21T05:08:08.925934+0000 mon.a (mon.0) 910 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: audit 2024-09-21T05:08:08.926498+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:08:10.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[19831]: audit 2024-09-21T05:08:08.928007+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: audit 2024-09-21T05:08:08.923885+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: audit 2024-09-21T05:08:08.924489+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: cluster 2024-09-21T05:08:08.925761+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: cluster 2024-09-21T05:08:08.925934+0000 mon.a (mon.0) 910 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: audit 2024-09-21T05:08:08.926498+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:08:10.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:09 smithi089 bash[26514]: audit 2024-09-21T05:08:08.928007+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: audit 2024-09-21T05:08:08.923885+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: audit 2024-09-21T05:08:08.924489+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: cluster 2024-09-21T05:08:08.925761+0000 mon.a (mon.0) 909 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: cluster 2024-09-21T05:08:08.925934+0000 mon.a (mon.0) 910 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: audit 2024-09-21T05:08:08.926498+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:08:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:09 smithi110 bash[22020]: audit 2024-09-21T05:08:08.928007+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[19831]: cluster 2024-09-21T05:08:09.922385+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e22: y(active, since 7m), standbys: x 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[19831]: audit 2024-09-21T05:08:10.514027+0000 mon.c (mon.2) 144 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[19831]: cluster 2024-09-21T05:08:10.607015+0000 mgr.y (mgr.14385) 328 : cluster [DBG] pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[26514]: cluster 2024-09-21T05:08:09.922385+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e22: y(active, since 7m), standbys: x 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[26514]: audit 2024-09-21T05:08:10.514027+0000 mon.c (mon.2) 144 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:11.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:10 smithi089 bash[26514]: cluster 2024-09-21T05:08:10.607015+0000 mgr.y (mgr.14385) 328 : cluster [DBG] pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:10 smithi110 bash[22020]: cluster 2024-09-21T05:08:09.922385+0000 mon.a (mon.0) 911 : cluster [DBG] mgrmap e22: y(active, since 7m), standbys: x 2024-09-21T05:08:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:10 smithi110 bash[22020]: audit 2024-09-21T05:08:10.514027+0000 mon.c (mon.2) 144 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:10 smithi110 bash[22020]: cluster 2024-09-21T05:08:10.607015+0000 mgr.y (mgr.14385) 328 : cluster [DBG] pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:12.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:11] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:08:14.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:13 smithi089 bash[19831]: cluster 2024-09-21T05:08:12.608667+0000 mgr.y (mgr.14385) 329 : cluster [DBG] pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:13 smithi089 bash[26514]: cluster 2024-09-21T05:08:12.608667+0000 mgr.y (mgr.14385) 329 : cluster [DBG] pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:13 smithi110 bash[22020]: cluster 2024-09-21T05:08:12.608667+0000 mgr.y (mgr.14385) 329 : cluster [DBG] pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:15 smithi089 bash[19831]: cluster 2024-09-21T05:08:14.609335+0000 mgr.y (mgr.14385) 330 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:15 smithi089 bash[26514]: cluster 2024-09-21T05:08:14.609335+0000 mgr.y (mgr.14385) 330 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:15 smithi110 bash[22020]: cluster 2024-09-21T05:08:14.609335+0000 mgr.y (mgr.14385) 330 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:18.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:17 smithi089 bash[19831]: cluster 2024-09-21T05:08:16.610975+0000 mgr.y (mgr.14385) 331 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:17 smithi089 bash[26514]: cluster 2024-09-21T05:08:16.610975+0000 mgr.y (mgr.14385) 331 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:17 smithi110 bash[22020]: cluster 2024-09-21T05:08:16.610975+0000 mgr.y (mgr.14385) 331 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:19 smithi089 bash[19831]: audit 2024-09-21T05:08:18.145269+0000 mgr.y (mgr.14385) 332 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:19 smithi089 bash[19831]: cluster 2024-09-21T05:08:18.611649+0000 mgr.y (mgr.14385) 333 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:19 smithi089 bash[26514]: audit 2024-09-21T05:08:18.145269+0000 mgr.y (mgr.14385) 332 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:19 smithi089 bash[26514]: cluster 2024-09-21T05:08:18.611649+0000 mgr.y (mgr.14385) 333 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:19 smithi110 bash[22020]: audit 2024-09-21T05:08:18.145269+0000 mgr.y (mgr.14385) 332 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:19 smithi110 bash[22020]: cluster 2024-09-21T05:08:18.611649+0000 mgr.y (mgr.14385) 333 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:22.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:21] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:08:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:21 smithi089 bash[19831]: cluster 2024-09-21T05:08:20.612367+0000 mgr.y (mgr.14385) 334 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:21 smithi089 bash[26514]: cluster 2024-09-21T05:08:20.612367+0000 mgr.y (mgr.14385) 334 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:21 smithi110 bash[22020]: cluster 2024-09-21T05:08:20.612367+0000 mgr.y (mgr.14385) 334 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:24.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:23 smithi089 bash[19831]: cluster 2024-09-21T05:08:22.614066+0000 mgr.y (mgr.14385) 335 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:23 smithi089 bash[26514]: cluster 2024-09-21T05:08:22.614066+0000 mgr.y (mgr.14385) 335 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:23 smithi110 bash[22020]: cluster 2024-09-21T05:08:22.614066+0000 mgr.y (mgr.14385) 335 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:26.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:25 smithi089 bash[19831]: cluster 2024-09-21T05:08:24.614818+0000 mgr.y (mgr.14385) 336 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:26.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:25 smithi089 bash[19831]: audit 2024-09-21T05:08:25.514407+0000 mon.c (mon.2) 145 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:25 smithi089 bash[26514]: cluster 2024-09-21T05:08:24.614818+0000 mgr.y (mgr.14385) 336 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:25 smithi089 bash[26514]: audit 2024-09-21T05:08:25.514407+0000 mon.c (mon.2) 145 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:25 smithi110 bash[22020]: cluster 2024-09-21T05:08:24.614818+0000 mgr.y (mgr.14385) 336 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:08:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:25 smithi110 bash[22020]: audit 2024-09-21T05:08:25.514407+0000 mon.c (mon.2) 145 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:28.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:27 smithi089 bash[19831]: cluster 2024-09-21T05:08:26.616828+0000 mgr.y (mgr.14385) 337 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:27 smithi089 bash[26514]: cluster 2024-09-21T05:08:26.616828+0000 mgr.y (mgr.14385) 337 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:27 smithi110 bash[22020]: cluster 2024-09-21T05:08:26.616828+0000 mgr.y (mgr.14385) 337 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:29 smithi089 bash[19831]: audit 2024-09-21T05:08:28.156458+0000 mgr.y (mgr.14385) 338 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:29 smithi089 bash[19831]: cluster 2024-09-21T05:08:28.617547+0000 mgr.y (mgr.14385) 339 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:29 smithi089 bash[26514]: audit 2024-09-21T05:08:28.156458+0000 mgr.y (mgr.14385) 338 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:29 smithi089 bash[26514]: cluster 2024-09-21T05:08:28.617547+0000 mgr.y (mgr.14385) 339 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:29 smithi110 bash[22020]: audit 2024-09-21T05:08:28.156458+0000 mgr.y (mgr.14385) 338 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:29 smithi110 bash[22020]: cluster 2024-09-21T05:08:28.617547+0000 mgr.y (mgr.14385) 339 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:32.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:31 smithi089 bash[19831]: cluster 2024-09-21T05:08:30.618265+0000 mgr.y (mgr.14385) 340 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:32.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:31] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.43.0" 2024-09-21T05:08:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:31 smithi089 bash[26514]: cluster 2024-09-21T05:08:30.618265+0000 mgr.y (mgr.14385) 340 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:31 smithi110 bash[22020]: cluster 2024-09-21T05:08:30.618265+0000 mgr.y (mgr.14385) 340 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:34.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:33 smithi089 bash[19831]: cluster 2024-09-21T05:08:32.619939+0000 mgr.y (mgr.14385) 341 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:34.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:33 smithi089 bash[26514]: cluster 2024-09-21T05:08:32.619939+0000 mgr.y (mgr.14385) 341 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:33 smithi110 bash[22020]: cluster 2024-09-21T05:08:32.619939+0000 mgr.y (mgr.14385) 341 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:36.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:35 smithi089 bash[19831]: cluster 2024-09-21T05:08:34.620652+0000 mgr.y (mgr.14385) 342 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:36.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:35 smithi089 bash[26514]: cluster 2024-09-21T05:08:34.620652+0000 mgr.y (mgr.14385) 342 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:35 smithi110 bash[22020]: cluster 2024-09-21T05:08:34.620652+0000 mgr.y (mgr.14385) 342 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:38.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:37 smithi089 bash[19831]: cluster 2024-09-21T05:08:36.622291+0000 mgr.y (mgr.14385) 343 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:38.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:37 smithi089 bash[26514]: cluster 2024-09-21T05:08:36.622291+0000 mgr.y (mgr.14385) 343 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:37 smithi110 bash[22020]: cluster 2024-09-21T05:08:36.622291+0000 mgr.y (mgr.14385) 343 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:39 smithi089 bash[19831]: audit 2024-09-21T05:08:38.167704+0000 mgr.y (mgr.14385) 344 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:39 smithi089 bash[19831]: cluster 2024-09-21T05:08:38.622995+0000 mgr.y (mgr.14385) 345 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:39 smithi089 bash[26514]: audit 2024-09-21T05:08:38.167704+0000 mgr.y (mgr.14385) 344 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:39 smithi089 bash[26514]: cluster 2024-09-21T05:08:38.622995+0000 mgr.y (mgr.14385) 345 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:39 smithi110 bash[22020]: audit 2024-09-21T05:08:38.167704+0000 mgr.y (mgr.14385) 344 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:39 smithi110 bash[22020]: cluster 2024-09-21T05:08:38.622995+0000 mgr.y (mgr.14385) 345 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:41.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:40 smithi089 bash[19831]: audit 2024-09-21T05:08:40.514951+0000 mon.c (mon.2) 146 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:41.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:40 smithi089 bash[26514]: audit 2024-09-21T05:08:40.514951+0000 mon.c (mon.2) 146 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:40 smithi110 bash[22020]: audit 2024-09-21T05:08:40.514951+0000 mon.c (mon.2) 146 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:42.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:41 smithi089 bash[19831]: cluster 2024-09-21T05:08:40.623661+0000 mgr.y (mgr.14385) 346 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:42.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:41] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:08:42.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:41 smithi089 bash[26514]: cluster 2024-09-21T05:08:40.623661+0000 mgr.y (mgr.14385) 346 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:41 smithi110 bash[22020]: cluster 2024-09-21T05:08:40.623661+0000 mgr.y (mgr.14385) 346 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:43.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:42 smithi089 bash[19831]: cluster 2024-09-21T05:08:42.625382+0000 mgr.y (mgr.14385) 347 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:43.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:42 smithi089 bash[26514]: cluster 2024-09-21T05:08:42.625382+0000 mgr.y (mgr.14385) 347 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:43.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:42 smithi110 bash[22020]: cluster 2024-09-21T05:08:42.625382+0000 mgr.y (mgr.14385) 347 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:46.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:45 smithi089 bash[19831]: cluster 2024-09-21T05:08:44.626094+0000 mgr.y (mgr.14385) 348 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:46.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:45 smithi089 bash[26514]: cluster 2024-09-21T05:08:44.626094+0000 mgr.y (mgr.14385) 348 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:45 smithi110 bash[22020]: cluster 2024-09-21T05:08:44.626094+0000 mgr.y (mgr.14385) 348 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:48.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:47 smithi089 bash[19831]: cluster 2024-09-21T05:08:46.627763+0000 mgr.y (mgr.14385) 349 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:48.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:47 smithi089 bash[26514]: cluster 2024-09-21T05:08:46.627763+0000 mgr.y (mgr.14385) 349 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:47 smithi110 bash[22020]: cluster 2024-09-21T05:08:46.627763+0000 mgr.y (mgr.14385) 349 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:50.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:49 smithi089 bash[19831]: audit 2024-09-21T05:08:48.178125+0000 mgr.y (mgr.14385) 350 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:50.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:49 smithi089 bash[19831]: cluster 2024-09-21T05:08:48.628469+0000 mgr.y (mgr.14385) 351 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:50.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:49 smithi089 bash[26514]: audit 2024-09-21T05:08:48.178125+0000 mgr.y (mgr.14385) 350 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:50.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:49 smithi089 bash[26514]: cluster 2024-09-21T05:08:48.628469+0000 mgr.y (mgr.14385) 351 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:49 smithi110 bash[22020]: audit 2024-09-21T05:08:48.178125+0000 mgr.y (mgr.14385) 350 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:08:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:49 smithi110 bash[22020]: cluster 2024-09-21T05:08:48.628469+0000 mgr.y (mgr.14385) 351 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:52.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:51 smithi089 bash[19831]: cluster 2024-09-21T05:08:50.629191+0000 mgr.y (mgr.14385) 352 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:52.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:08:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:08:51] "GET /metrics HTTP/1.1" 200 38158 "" "Prometheus/2.43.0" 2024-09-21T05:08:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:51 smithi089 bash[26514]: cluster 2024-09-21T05:08:50.629191+0000 mgr.y (mgr.14385) 352 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:51 smithi110 bash[22020]: cluster 2024-09-21T05:08:50.629191+0000 mgr.y (mgr.14385) 352 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:54.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:53 smithi089 bash[19831]: cluster 2024-09-21T05:08:52.630945+0000 mgr.y (mgr.14385) 353 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:54.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:53 smithi089 bash[26514]: cluster 2024-09-21T05:08:52.630945+0000 mgr.y (mgr.14385) 353 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:53 smithi110 bash[22020]: cluster 2024-09-21T05:08:52.630945+0000 mgr.y (mgr.14385) 353 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:55 smithi089 bash[19831]: cluster 2024-09-21T05:08:54.631599+0000 mgr.y (mgr.14385) 354 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:55 smithi089 bash[19831]: audit 2024-09-21T05:08:55.515344+0000 mon.c (mon.2) 147 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:56.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:55 smithi089 bash[26514]: cluster 2024-09-21T05:08:54.631599+0000 mgr.y (mgr.14385) 354 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:55 smithi089 bash[26514]: audit 2024-09-21T05:08:55.515344+0000 mon.c (mon.2) 147 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:55 smithi110 bash[22020]: cluster 2024-09-21T05:08:54.631599+0000 mgr.y (mgr.14385) 354 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:08:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:55 smithi110 bash[22020]: audit 2024-09-21T05:08:55.515344+0000 mon.c (mon.2) 147 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:08:58.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:57 smithi089 bash[19831]: cluster 2024-09-21T05:08:56.633226+0000 mgr.y (mgr.14385) 355 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:58.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:57 smithi089 bash[26514]: cluster 2024-09-21T05:08:56.633226+0000 mgr.y (mgr.14385) 355 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:08:58.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:57 smithi110 bash[22020]: cluster 2024-09-21T05:08:56.633226+0000 mgr.y (mgr.14385) 355 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:00.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:59 smithi089 bash[26514]: audit 2024-09-21T05:08:58.189189+0000 mgr.y (mgr.14385) 356 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:00.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:08:59 smithi089 bash[26514]: cluster 2024-09-21T05:08:58.633968+0000 mgr.y (mgr.14385) 357 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:00.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:59 smithi089 bash[19831]: audit 2024-09-21T05:08:58.189189+0000 mgr.y (mgr.14385) 356 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:00.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:08:59 smithi089 bash[19831]: cluster 2024-09-21T05:08:58.633968+0000 mgr.y (mgr.14385) 357 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:59 smithi110 bash[22020]: audit 2024-09-21T05:08:58.189189+0000 mgr.y (mgr.14385) 356 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:08:59 smithi110 bash[22020]: cluster 2024-09-21T05:08:58.633968+0000 mgr.y (mgr.14385) 357 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:02.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:01 smithi089 bash[19831]: cluster 2024-09-21T05:09:00.634782+0000 mgr.y (mgr.14385) 358 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:02.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:01] "GET /metrics HTTP/1.1" 200 38155 "" "Prometheus/2.43.0" 2024-09-21T05:09:02.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:01 smithi089 bash[26514]: cluster 2024-09-21T05:09:00.634782+0000 mgr.y (mgr.14385) 358 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:02.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:01 smithi110 bash[22020]: cluster 2024-09-21T05:09:00.634782+0000 mgr.y (mgr.14385) 358 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:04.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:03 smithi089 bash[19831]: cluster 2024-09-21T05:09:02.636457+0000 mgr.y (mgr.14385) 359 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:04.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:03 smithi089 bash[26514]: cluster 2024-09-21T05:09:02.636457+0000 mgr.y (mgr.14385) 359 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:04.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:03 smithi110 bash[22020]: cluster 2024-09-21T05:09:02.636457+0000 mgr.y (mgr.14385) 359 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:06.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:05 smithi089 bash[19831]: cluster 2024-09-21T05:09:04.637169+0000 mgr.y (mgr.14385) 360 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:06.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:05 smithi089 bash[26514]: cluster 2024-09-21T05:09:04.637169+0000 mgr.y (mgr.14385) 360 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:06.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:05 smithi110 bash[22020]: cluster 2024-09-21T05:09:04.637169+0000 mgr.y (mgr.14385) 360 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:08.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:07 smithi089 bash[19831]: cluster 2024-09-21T05:09:06.638787+0000 mgr.y (mgr.14385) 361 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:08.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:07 smithi089 bash[26514]: cluster 2024-09-21T05:09:06.638787+0000 mgr.y (mgr.14385) 361 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:07 smithi110 bash[22020]: cluster 2024-09-21T05:09:06.638787+0000 mgr.y (mgr.14385) 361 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:10.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:09 smithi089 bash[19831]: audit 2024-09-21T05:09:08.200491+0000 mgr.y (mgr.14385) 362 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:10.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:09 smithi089 bash[19831]: cluster 2024-09-21T05:09:08.639477+0000 mgr.y (mgr.14385) 363 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:10.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:09 smithi089 bash[26514]: audit 2024-09-21T05:09:08.200491+0000 mgr.y (mgr.14385) 362 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:10.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:09 smithi089 bash[26514]: cluster 2024-09-21T05:09:08.639477+0000 mgr.y (mgr.14385) 363 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:09 smithi110 bash[22020]: audit 2024-09-21T05:09:08.200491+0000 mgr.y (mgr.14385) 362 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:09 smithi110 bash[22020]: cluster 2024-09-21T05:09:08.639477+0000 mgr.y (mgr.14385) 363 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:11.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:10 smithi089 bash[19831]: audit 2024-09-21T05:09:10.515662+0000 mon.c (mon.2) 148 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:11.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:10 smithi089 bash[19831]: cluster 2024-09-21T05:09:10.640288+0000 mgr.y (mgr.14385) 364 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:11.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:10 smithi089 bash[26514]: audit 2024-09-21T05:09:10.515662+0000 mon.c (mon.2) 148 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:11.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:10 smithi089 bash[26514]: cluster 2024-09-21T05:09:10.640288+0000 mgr.y (mgr.14385) 364 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:11.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:10 smithi110 bash[22020]: audit 2024-09-21T05:09:10.515662+0000 mon.c (mon.2) 148 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:10 smithi110 bash[22020]: cluster 2024-09-21T05:09:10.640288+0000 mgr.y (mgr.14385) 364 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:12.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:11] "GET /metrics HTTP/1.1" 200 38155 "" "Prometheus/2.43.0" 2024-09-21T05:09:14.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:13 smithi089 bash[19831]: cluster 2024-09-21T05:09:12.642123+0000 mgr.y (mgr.14385) 365 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:14.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:13 smithi089 bash[26514]: cluster 2024-09-21T05:09:12.642123+0000 mgr.y (mgr.14385) 365 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:14.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:13 smithi110 bash[22020]: cluster 2024-09-21T05:09:12.642123+0000 mgr.y (mgr.14385) 365 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: cluster 2024-09-21T05:09:14.642948+0000 mgr.y (mgr.14385) 366 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: audit 2024-09-21T05:09:14.751165+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: audit 2024-09-21T05:09:14.765013+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: audit 2024-09-21T05:09:15.419748+0000 mon.c (mon.2) 149 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: audit 2024-09-21T05:09:15.421407+0000 mon.c (mon.2) 150 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[19831]: audit 2024-09-21T05:09:15.431004+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: cluster 2024-09-21T05:09:14.642948+0000 mgr.y (mgr.14385) 366 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: audit 2024-09-21T05:09:14.751165+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: audit 2024-09-21T05:09:14.765013+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: audit 2024-09-21T05:09:15.419748+0000 mon.c (mon.2) 149 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: audit 2024-09-21T05:09:15.421407+0000 mon.c (mon.2) 150 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:15 smithi089 bash[26514]: audit 2024-09-21T05:09:15.431004+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: cluster 2024-09-21T05:09:14.642948+0000 mgr.y (mgr.14385) 366 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: audit 2024-09-21T05:09:14.751165+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: audit 2024-09-21T05:09:14.765013+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: audit 2024-09-21T05:09:15.419748+0000 mon.c (mon.2) 149 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: audit 2024-09-21T05:09:15.421407+0000 mon.c (mon.2) 150 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:09:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:15 smithi110 bash[22020]: audit 2024-09-21T05:09:15.431004+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:09:18.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:17 smithi089 bash[19831]: cluster 2024-09-21T05:09:16.644604+0000 mgr.y (mgr.14385) 367 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:18.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:17 smithi089 bash[26514]: cluster 2024-09-21T05:09:16.644604+0000 mgr.y (mgr.14385) 367 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:17 smithi110 bash[22020]: cluster 2024-09-21T05:09:16.644604+0000 mgr.y (mgr.14385) 367 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:19 smithi089 bash[19831]: audit 2024-09-21T05:09:18.211678+0000 mgr.y (mgr.14385) 368 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:19 smithi089 bash[19831]: cluster 2024-09-21T05:09:18.645288+0000 mgr.y (mgr.14385) 369 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:20.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:19 smithi089 bash[26514]: audit 2024-09-21T05:09:18.211678+0000 mgr.y (mgr.14385) 368 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:20.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:19 smithi089 bash[26514]: cluster 2024-09-21T05:09:18.645288+0000 mgr.y (mgr.14385) 369 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:19 smithi110 bash[22020]: audit 2024-09-21T05:09:18.211678+0000 mgr.y (mgr.14385) 368 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:19 smithi110 bash[22020]: cluster 2024-09-21T05:09:18.645288+0000 mgr.y (mgr.14385) 369 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:22.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:21 smithi089 bash[19831]: cluster 2024-09-21T05:09:20.646029+0000 mgr.y (mgr.14385) 370 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:22.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:21] "GET /metrics HTTP/1.1" 200 38155 "" "Prometheus/2.43.0" 2024-09-21T05:09:22.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:21 smithi089 bash[26514]: cluster 2024-09-21T05:09:20.646029+0000 mgr.y (mgr.14385) 370 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:22.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:21 smithi110 bash[22020]: cluster 2024-09-21T05:09:20.646029+0000 mgr.y (mgr.14385) 370 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:24.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:23 smithi089 bash[19831]: cluster 2024-09-21T05:09:22.647651+0000 mgr.y (mgr.14385) 371 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:24.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:23 smithi089 bash[26514]: cluster 2024-09-21T05:09:22.647651+0000 mgr.y (mgr.14385) 371 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:23 smithi110 bash[22020]: cluster 2024-09-21T05:09:22.647651+0000 mgr.y (mgr.14385) 371 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:26.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:25 smithi089 bash[19831]: cluster 2024-09-21T05:09:24.648451+0000 mgr.y (mgr.14385) 372 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:26.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:25 smithi089 bash[19831]: audit 2024-09-21T05:09:25.516127+0000 mon.c (mon.2) 151 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:26.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:25 smithi089 bash[26514]: cluster 2024-09-21T05:09:24.648451+0000 mgr.y (mgr.14385) 372 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:26.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:25 smithi089 bash[26514]: audit 2024-09-21T05:09:25.516127+0000 mon.c (mon.2) 151 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:25 smithi110 bash[22020]: cluster 2024-09-21T05:09:24.648451+0000 mgr.y (mgr.14385) 372 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:25 smithi110 bash[22020]: audit 2024-09-21T05:09:25.516127+0000 mon.c (mon.2) 151 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:28.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:27 smithi089 bash[19831]: cluster 2024-09-21T05:09:26.650140+0000 mgr.y (mgr.14385) 373 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:28.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:27 smithi089 bash[26514]: cluster 2024-09-21T05:09:26.650140+0000 mgr.y (mgr.14385) 373 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:27 smithi110 bash[22020]: cluster 2024-09-21T05:09:26.650140+0000 mgr.y (mgr.14385) 373 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:29 smithi089 bash[19831]: audit 2024-09-21T05:09:28.222906+0000 mgr.y (mgr.14385) 374 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:29 smithi089 bash[19831]: cluster 2024-09-21T05:09:28.650846+0000 mgr.y (mgr.14385) 375 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:30.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:29 smithi089 bash[26514]: audit 2024-09-21T05:09:28.222906+0000 mgr.y (mgr.14385) 374 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:30.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:29 smithi089 bash[26514]: cluster 2024-09-21T05:09:28.650846+0000 mgr.y (mgr.14385) 375 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:29 smithi110 bash[22020]: audit 2024-09-21T05:09:28.222906+0000 mgr.y (mgr.14385) 374 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:29 smithi110 bash[22020]: cluster 2024-09-21T05:09:28.650846+0000 mgr.y (mgr.14385) 375 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:32.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:31 smithi089 bash[19831]: cluster 2024-09-21T05:09:30.651530+0000 mgr.y (mgr.14385) 376 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:32.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:31] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:09:32.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:31 smithi089 bash[26514]: cluster 2024-09-21T05:09:30.651530+0000 mgr.y (mgr.14385) 376 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:32.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:31 smithi110 bash[22020]: cluster 2024-09-21T05:09:30.651530+0000 mgr.y (mgr.14385) 376 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:33.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:32 smithi089 bash[19831]: cluster 2024-09-21T05:09:32.653203+0000 mgr.y (mgr.14385) 377 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:33.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:32 smithi089 bash[26514]: cluster 2024-09-21T05:09:32.653203+0000 mgr.y (mgr.14385) 377 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:33.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:32 smithi110 bash[22020]: cluster 2024-09-21T05:09:32.653203+0000 mgr.y (mgr.14385) 377 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:36.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:35 smithi089 bash[19831]: cluster 2024-09-21T05:09:34.653912+0000 mgr.y (mgr.14385) 378 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:36.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:35 smithi089 bash[26514]: cluster 2024-09-21T05:09:34.653912+0000 mgr.y (mgr.14385) 378 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:36.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:35 smithi110 bash[22020]: cluster 2024-09-21T05:09:34.653912+0000 mgr.y (mgr.14385) 378 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:38.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:37 smithi089 bash[19831]: cluster 2024-09-21T05:09:36.655542+0000 mgr.y (mgr.14385) 379 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:38.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:37 smithi089 bash[26514]: cluster 2024-09-21T05:09:36.655542+0000 mgr.y (mgr.14385) 379 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:38.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:37 smithi110 bash[22020]: cluster 2024-09-21T05:09:36.655542+0000 mgr.y (mgr.14385) 379 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:39 smithi089 bash[19831]: audit 2024-09-21T05:09:38.234116+0000 mgr.y (mgr.14385) 380 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:39 smithi089 bash[19831]: cluster 2024-09-21T05:09:38.656252+0000 mgr.y (mgr.14385) 381 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:40.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:39 smithi089 bash[26514]: audit 2024-09-21T05:09:38.234116+0000 mgr.y (mgr.14385) 380 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:40.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:39 smithi089 bash[26514]: cluster 2024-09-21T05:09:38.656252+0000 mgr.y (mgr.14385) 381 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:40.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:39 smithi110 bash[22020]: audit 2024-09-21T05:09:38.234116+0000 mgr.y (mgr.14385) 380 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:40.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:39 smithi110 bash[22020]: cluster 2024-09-21T05:09:38.656252+0000 mgr.y (mgr.14385) 381 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:41.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:40 smithi089 bash[19831]: audit 2024-09-21T05:09:40.516382+0000 mon.c (mon.2) 152 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:41.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:40 smithi089 bash[26514]: audit 2024-09-21T05:09:40.516382+0000 mon.c (mon.2) 152 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:41.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:40 smithi110 bash[22020]: audit 2024-09-21T05:09:40.516382+0000 mon.c (mon.2) 152 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:42.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:41 smithi089 bash[19831]: cluster 2024-09-21T05:09:40.656906+0000 mgr.y (mgr.14385) 382 : cluster [DBG] pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:42.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:41] "GET /metrics HTTP/1.1" 200 38152 "" "Prometheus/2.43.0" 2024-09-21T05:09:42.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:41 smithi089 bash[26514]: cluster 2024-09-21T05:09:40.656906+0000 mgr.y (mgr.14385) 382 : cluster [DBG] pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:42.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:41 smithi110 bash[22020]: cluster 2024-09-21T05:09:40.656906+0000 mgr.y (mgr.14385) 382 : cluster [DBG] pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:44.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:43 smithi089 bash[26514]: cluster 2024-09-21T05:09:42.658615+0000 mgr.y (mgr.14385) 383 : cluster [DBG] pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:44.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:43 smithi089 bash[19831]: cluster 2024-09-21T05:09:42.658615+0000 mgr.y (mgr.14385) 383 : cluster [DBG] pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:44.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:43 smithi110 bash[22020]: cluster 2024-09-21T05:09:42.658615+0000 mgr.y (mgr.14385) 383 : cluster [DBG] pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:46.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:45 smithi089 bash[26514]: cluster 2024-09-21T05:09:44.659306+0000 mgr.y (mgr.14385) 384 : cluster [DBG] pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:46.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:45 smithi089 bash[19831]: cluster 2024-09-21T05:09:44.659306+0000 mgr.y (mgr.14385) 384 : cluster [DBG] pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:46.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:45 smithi110 bash[22020]: cluster 2024-09-21T05:09:44.659306+0000 mgr.y (mgr.14385) 384 : cluster [DBG] pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:48.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:47 smithi089 bash[19831]: cluster 2024-09-21T05:09:46.660902+0000 mgr.y (mgr.14385) 385 : cluster [DBG] pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:48.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:47 smithi089 bash[26514]: cluster 2024-09-21T05:09:46.660902+0000 mgr.y (mgr.14385) 385 : cluster [DBG] pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:48.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:47 smithi110 bash[22020]: cluster 2024-09-21T05:09:46.660902+0000 mgr.y (mgr.14385) 385 : cluster [DBG] pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:49.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:48 smithi089 bash[19831]: audit 2024-09-21T05:09:48.245266+0000 mgr.y (mgr.14385) 386 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:49.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:48 smithi089 bash[19831]: cluster 2024-09-21T05:09:48.661585+0000 mgr.y (mgr.14385) 387 : cluster [DBG] pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:48 smithi089 bash[26514]: audit 2024-09-21T05:09:48.245266+0000 mgr.y (mgr.14385) 386 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:48 smithi089 bash[26514]: cluster 2024-09-21T05:09:48.661585+0000 mgr.y (mgr.14385) 387 : cluster [DBG] pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:48 smithi110 bash[22020]: audit 2024-09-21T05:09:48.245266+0000 mgr.y (mgr.14385) 386 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:09:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:48 smithi110 bash[22020]: cluster 2024-09-21T05:09:48.661585+0000 mgr.y (mgr.14385) 387 : cluster [DBG] pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:52.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:51 smithi089 bash[19831]: cluster 2024-09-21T05:09:50.662251+0000 mgr.y (mgr.14385) 388 : cluster [DBG] pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:52.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:09:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:09:51] "GET /metrics HTTP/1.1" 200 38152 "" "Prometheus/2.43.0" 2024-09-21T05:09:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:51 smithi089 bash[26514]: cluster 2024-09-21T05:09:50.662251+0000 mgr.y (mgr.14385) 388 : cluster [DBG] pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:52.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:51 smithi110 bash[22020]: cluster 2024-09-21T05:09:50.662251+0000 mgr.y (mgr.14385) 388 : cluster [DBG] pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:54.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:53 smithi089 bash[19831]: cluster 2024-09-21T05:09:52.663874+0000 mgr.y (mgr.14385) 389 : cluster [DBG] pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:54.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:53 smithi089 bash[26514]: cluster 2024-09-21T05:09:52.663874+0000 mgr.y (mgr.14385) 389 : cluster [DBG] pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:54.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:53 smithi110 bash[22020]: cluster 2024-09-21T05:09:52.663874+0000 mgr.y (mgr.14385) 389 : cluster [DBG] pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:55 smithi089 bash[19831]: cluster 2024-09-21T05:09:54.664527+0000 mgr.y (mgr.14385) 390 : cluster [DBG] pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:55 smithi089 bash[19831]: audit 2024-09-21T05:09:55.516690+0000 mon.c (mon.2) 153 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:56.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:55 smithi089 bash[26514]: cluster 2024-09-21T05:09:54.664527+0000 mgr.y (mgr.14385) 390 : cluster [DBG] pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:55 smithi089 bash[26514]: audit 2024-09-21T05:09:55.516690+0000 mon.c (mon.2) 153 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:56.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:55 smithi110 bash[22020]: cluster 2024-09-21T05:09:54.664527+0000 mgr.y (mgr.14385) 390 : cluster [DBG] pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:09:56.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:55 smithi110 bash[22020]: audit 2024-09-21T05:09:55.516690+0000 mon.c (mon.2) 153 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:09:58.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:57 smithi089 bash[19831]: cluster 2024-09-21T05:09:56.666203+0000 mgr.y (mgr.14385) 391 : cluster [DBG] pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:58.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:57 smithi089 bash[26514]: cluster 2024-09-21T05:09:56.666203+0000 mgr.y (mgr.14385) 391 : cluster [DBG] pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:09:58.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:57 smithi110 bash[22020]: cluster 2024-09-21T05:09:56.666203+0000 mgr.y (mgr.14385) 391 : cluster [DBG] pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:00.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:59 smithi089 bash[19831]: audit 2024-09-21T05:09:58.254177+0000 mgr.y (mgr.14385) 392 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:00.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:09:59 smithi089 bash[19831]: cluster 2024-09-21T05:09:58.666899+0000 mgr.y (mgr.14385) 393 : cluster [DBG] pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:00.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:59 smithi089 bash[26514]: audit 2024-09-21T05:09:58.254177+0000 mgr.y (mgr.14385) 392 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:00.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:09:59 smithi089 bash[26514]: cluster 2024-09-21T05:09:58.666899+0000 mgr.y (mgr.14385) 393 : cluster [DBG] pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:00.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:59 smithi110 bash[22020]: audit 2024-09-21T05:09:58.254177+0000 mgr.y (mgr.14385) 392 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:00.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:09:59 smithi110 bash[22020]: cluster 2024-09-21T05:09:58.666899+0000 mgr.y (mgr.14385) 393 : cluster [DBG] pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:01.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:00 smithi089 bash[19831]: cluster 2024-09-21T05:10:00.000155+0000 mon.a (mon.0) 915 : cluster [INF] overall HEALTH_OK 2024-09-21T05:10:01.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:00 smithi089 bash[26514]: cluster 2024-09-21T05:10:00.000155+0000 mon.a (mon.0) 915 : cluster [INF] overall HEALTH_OK 2024-09-21T05:10:01.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:00 smithi110 bash[22020]: cluster 2024-09-21T05:10:00.000155+0000 mon.a (mon.0) 915 : cluster [INF] overall HEALTH_OK 2024-09-21T05:10:02.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:01 smithi089 bash[19831]: cluster 2024-09-21T05:10:00.667609+0000 mgr.y (mgr.14385) 394 : cluster [DBG] pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:02.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:01 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:01] "GET /metrics HTTP/1.1" 200 38157 "" "Prometheus/2.43.0" 2024-09-21T05:10:02.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:01 smithi089 bash[26514]: cluster 2024-09-21T05:10:00.667609+0000 mgr.y (mgr.14385) 394 : cluster [DBG] pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:02.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:01 smithi110 bash[22020]: cluster 2024-09-21T05:10:00.667609+0000 mgr.y (mgr.14385) 394 : cluster [DBG] pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:03.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:02 smithi089 bash[19831]: cluster 2024-09-21T05:10:02.669370+0000 mgr.y (mgr.14385) 395 : cluster [DBG] pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:03.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:02 smithi089 bash[26514]: cluster 2024-09-21T05:10:02.669370+0000 mgr.y (mgr.14385) 395 : cluster [DBG] pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:03.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:02 smithi110 bash[22020]: cluster 2024-09-21T05:10:02.669370+0000 mgr.y (mgr.14385) 395 : cluster [DBG] pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:06.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:05 smithi089 bash[19831]: cluster 2024-09-21T05:10:04.670108+0000 mgr.y (mgr.14385) 396 : cluster [DBG] pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:06.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:05 smithi089 bash[26514]: cluster 2024-09-21T05:10:04.670108+0000 mgr.y (mgr.14385) 396 : cluster [DBG] pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:06.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:05 smithi110 bash[22020]: cluster 2024-09-21T05:10:04.670108+0000 mgr.y (mgr.14385) 396 : cluster [DBG] pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:08.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:07 smithi089 bash[19831]: cluster 2024-09-21T05:10:06.671710+0000 mgr.y (mgr.14385) 397 : cluster [DBG] pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:08.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:07 smithi089 bash[26514]: cluster 2024-09-21T05:10:06.671710+0000 mgr.y (mgr.14385) 397 : cluster [DBG] pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:07 smithi110 bash[22020]: cluster 2024-09-21T05:10:06.671710+0000 mgr.y (mgr.14385) 397 : cluster [DBG] pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:10.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:09 smithi089 bash[19831]: audit 2024-09-21T05:10:08.265429+0000 mgr.y (mgr.14385) 398 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:10.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:09 smithi089 bash[19831]: cluster 2024-09-21T05:10:08.672391+0000 mgr.y (mgr.14385) 399 : cluster [DBG] pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:09 smithi089 bash[26514]: audit 2024-09-21T05:10:08.265429+0000 mgr.y (mgr.14385) 398 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:09 smithi089 bash[26514]: cluster 2024-09-21T05:10:08.672391+0000 mgr.y (mgr.14385) 399 : cluster [DBG] pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:09 smithi110 bash[22020]: audit 2024-09-21T05:10:08.265429+0000 mgr.y (mgr.14385) 398 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:09 smithi110 bash[22020]: cluster 2024-09-21T05:10:08.672391+0000 mgr.y (mgr.14385) 399 : cluster [DBG] pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:11.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:10 smithi089 bash[19831]: audit 2024-09-21T05:10:10.517182+0000 mon.c (mon.2) 154 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:11.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:10 smithi089 bash[26514]: audit 2024-09-21T05:10:10.517182+0000 mon.c (mon.2) 154 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:11.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:10 smithi110 bash[22020]: audit 2024-09-21T05:10:10.517182+0000 mon.c (mon.2) 154 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:12.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:11 smithi089 bash[19831]: cluster 2024-09-21T05:10:10.673057+0000 mgr.y (mgr.14385) 400 : cluster [DBG] pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:12.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:11] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.43.0" 2024-09-21T05:10:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:11 smithi089 bash[26514]: cluster 2024-09-21T05:10:10.673057+0000 mgr.y (mgr.14385) 400 : cluster [DBG] pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:12.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:11 smithi110 bash[22020]: cluster 2024-09-21T05:10:10.673057+0000 mgr.y (mgr.14385) 400 : cluster [DBG] pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:13.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:12 smithi089 bash[19831]: cluster 2024-09-21T05:10:12.674776+0000 mgr.y (mgr.14385) 401 : cluster [DBG] pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:13.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:12 smithi089 bash[26514]: cluster 2024-09-21T05:10:12.674776+0000 mgr.y (mgr.14385) 401 : cluster [DBG] pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:13.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:12 smithi110 bash[22020]: cluster 2024-09-21T05:10:12.674776+0000 mgr.y (mgr.14385) 401 : cluster [DBG] pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:16.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:15 smithi089 bash[26514]: cluster 2024-09-21T05:10:14.675459+0000 mgr.y (mgr.14385) 402 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:15 smithi089 bash[19831]: cluster 2024-09-21T05:10:14.675459+0000 mgr.y (mgr.14385) 402 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:16.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:15 smithi110 bash[22020]: cluster 2024-09-21T05:10:14.675459+0000 mgr.y (mgr.14385) 402 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:17.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[19831]: audit 2024-09-21T05:10:16.352182+0000 mon.c (mon.2) 155 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:17.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[19831]: audit 2024-09-21T05:10:16.353542+0000 mon.c (mon.2) 156 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:17.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[19831]: audit 2024-09-21T05:10:16.362819+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:10:17.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[26514]: audit 2024-09-21T05:10:16.352182+0000 mon.c (mon.2) 155 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:17.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[26514]: audit 2024-09-21T05:10:16.353542+0000 mon.c (mon.2) 156 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:17.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:16 smithi089 bash[26514]: audit 2024-09-21T05:10:16.362819+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:10:17.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:16 smithi110 bash[22020]: audit 2024-09-21T05:10:16.352182+0000 mon.c (mon.2) 155 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:10:17.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:16 smithi110 bash[22020]: audit 2024-09-21T05:10:16.353542+0000 mon.c (mon.2) 156 : audit [INF] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:10:17.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:16 smithi110 bash[22020]: audit 2024-09-21T05:10:16.362819+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.14385 ' entity='mgr.y' 2024-09-21T05:10:18.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:17 smithi089 bash[19831]: cluster 2024-09-21T05:10:16.677080+0000 mgr.y (mgr.14385) 403 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:18.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:17 smithi089 bash[26514]: cluster 2024-09-21T05:10:16.677080+0000 mgr.y (mgr.14385) 403 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:17 smithi110 bash[22020]: cluster 2024-09-21T05:10:16.677080+0000 mgr.y (mgr.14385) 403 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:19.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:10:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:19 smithi089 bash[19831]: audit 2024-09-21T05:10:18.272567+0000 mgr.y (mgr.14385) 404 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:19 smithi089 bash[19831]: cluster 2024-09-21T05:10:18.677865+0000 mgr.y (mgr.14385) 405 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:19 smithi089 bash[26514]: audit 2024-09-21T05:10:18.272567+0000 mgr.y (mgr.14385) 404 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:19 smithi089 bash[26514]: cluster 2024-09-21T05:10:18.677865+0000 mgr.y (mgr.14385) 405 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:19 smithi110 bash[22020]: audit 2024-09-21T05:10:18.272567+0000 mgr.y (mgr.14385) 404 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:19 smithi110 bash[22020]: cluster 2024-09-21T05:10:18.677865+0000 mgr.y (mgr.14385) 405 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:22.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:21 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:21] "GET /metrics HTTP/1.1" 200 38156 "" "Prometheus/2.43.0" 2024-09-21T05:10:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:21 smithi089 bash[19831]: cluster 2024-09-21T05:10:20.678577+0000 mgr.y (mgr.14385) 406 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:21 smithi089 bash[26514]: cluster 2024-09-21T05:10:20.678577+0000 mgr.y (mgr.14385) 406 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:22.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:21 smithi110 bash[22020]: cluster 2024-09-21T05:10:20.678577+0000 mgr.y (mgr.14385) 406 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:23.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:22 smithi089 bash[19831]: cluster 2024-09-21T05:10:22.680376+0000 mgr.y (mgr.14385) 407 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:23.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:22 smithi089 bash[26514]: cluster 2024-09-21T05:10:22.680376+0000 mgr.y (mgr.14385) 407 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:23.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:22 smithi110 bash[22020]: cluster 2024-09-21T05:10:22.680376+0000 mgr.y (mgr.14385) 407 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:24.268 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:25.822 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:10:25.822 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (9m) 2m ago 9m 13.9M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:10:25.822 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (9m) 71s ago 9m 75.6M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:10:25.822 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (7m) 2m ago 7m 47.7M - 3.8 164465d2334a 3b1e9d3a9a61 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (2m) 71s ago 18m 438M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:9283,8765 running (20m) 2m ago 20m 496M - 19.1.1-373-g4e45e6b4 164465d2334a 326bedf203f9 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (20m) 2m ago 20m 53.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (18m) 71s ago 18m 42.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (18m) 2m ago 18m 41.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (10m) 2m ago 10m 8340k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (10m) 71s ago 10m 8787k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (17m) 2m ago 17m 52.6M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (16m) 2m ago 16m 61.2M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (15m) 2m ago 15m 56.8M 4060M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (14m) 2m ago 14m 51.0M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:10:25.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (13m) 71s ago 13m 64.8M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (13m) 71s ago 13m 50.5M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (12m) 71s ago 12m 57.5M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (11m) 71s ago 11m 59.6M 4060M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (9m) 71s ago 10m 43.3M - 2.43.0 a07b618ecd1d f1ada0c8105d 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (7m) 2m ago 7m 93.2M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:10:25.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (7m) 71s ago 7m 94.5M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:10:26.004 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:25 smithi089 bash[19831]: cluster 2024-09-21T05:10:24.681226+0000 mgr.y (mgr.14385) 408 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:26.005 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:25 smithi089 bash[19831]: audit 2024-09-21T05:10:25.516988+0000 mon.c (mon.2) 157 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:26.005 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:25 smithi089 bash[26514]: cluster 2024-09-21T05:10:24.681226+0000 mgr.y (mgr.14385) 408 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:26.005 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:25 smithi089 bash[26514]: audit 2024-09-21T05:10:25.516988+0000 mon.c (mon.2) 157 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:25 smithi110 bash[22020]: cluster 2024-09-21T05:10:24.681226+0000 mgr.y (mgr.14385) 408 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:25 smithi110 bash[22020]: audit 2024-09-21T05:10:25.516988+0000 mon.c (mon.2) 157 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:26.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions' 2024-09-21T05:10:28.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:27 smithi089 bash[19831]: audit 2024-09-21T05:10:25.788951+0000 mgr.y (mgr.14385) 409 : audit [DBG] from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:27 smithi089 bash[19831]: cluster 2024-09-21T05:10:26.682435+0000 mgr.y (mgr.14385) 410 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:27 smithi089 bash[26514]: audit 2024-09-21T05:10:25.788951+0000 mgr.y (mgr.14385) 409 : audit [DBG] from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:27 smithi089 bash[26514]: cluster 2024-09-21T05:10:26.682435+0000 mgr.y (mgr.14385) 410 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:27 smithi110 bash[22020]: audit 2024-09-21T05:10:25.788951+0000 mgr.y (mgr.14385) 409 : audit [DBG] from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:10:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:27 smithi110 bash[22020]: cluster 2024-09-21T05:10:26.682435+0000 mgr.y (mgr.14385) 410 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:29 smithi089 bash[19831]: audit 2024-09-21T05:10:28.283836+0000 mgr.y (mgr.14385) 411 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:29 smithi089 bash[19831]: cluster 2024-09-21T05:10:28.683097+0000 mgr.y (mgr.14385) 412 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:29 smithi089 bash[26514]: audit 2024-09-21T05:10:28.283836+0000 mgr.y (mgr.14385) 411 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:29 smithi089 bash[26514]: cluster 2024-09-21T05:10:28.683097+0000 mgr.y (mgr.14385) 412 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:29 smithi110 bash[22020]: audit 2024-09-21T05:10:28.283836+0000 mgr.y (mgr.14385) 411 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:29 smithi110 bash[22020]: cluster 2024-09-21T05:10:28.683097+0000 mgr.y (mgr.14385) 412 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:31.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:30 smithi089 bash[19831]: cluster 2024-09-21T05:10:30.683774+0000 mgr.y (mgr.14385) 413 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:31.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:30 smithi089 bash[26514]: cluster 2024-09-21T05:10:30.683774+0000 mgr.y (mgr.14385) 413 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:31.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:30 smithi110 bash[22020]: cluster 2024-09-21T05:10:30.683774+0000 mgr.y (mgr.14385) 413 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:31.268 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:32.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:31 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:31] "GET /metrics HTTP/1.1" 200 38152 "" "Prometheus/2.43.0" 2024-09-21T05:10:32.733 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:10:32.733 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:10:32.734 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14, 2024-09-21T05:10:32.735 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:10:32.735 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:10:32.735 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:10:33.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:32 smithi089 bash[19831]: cluster 2024-09-21T05:10:32.685385+0000 mgr.y (mgr.14385) 414 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:33.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:32 smithi089 bash[19831]: audit 2024-09-21T05:10:32.737880+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.15.89:0/3047901465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:33.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:32 smithi089 bash[26514]: cluster 2024-09-21T05:10:32.685385+0000 mgr.y (mgr.14385) 414 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:33.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:32 smithi089 bash[26514]: audit 2024-09-21T05:10:32.737880+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.15.89:0/3047901465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:33.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:32 smithi110 bash[22020]: cluster 2024-09-21T05:10:32.685385+0000 mgr.y (mgr.14385) 414 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:33.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:32 smithi110 bash[22020]: audit 2024-09-21T05:10:32.737880+0000 mon.a (mon.0) 917 : audit [DBG] from='client.? 172.21.15.89:0/3047901465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:33.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph -s' 2024-09-21T05:10:36.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:35 smithi089 bash[19831]: cluster 2024-09-21T05:10:34.686105+0000 mgr.y (mgr.14385) 415 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:35 smithi089 bash[26514]: cluster 2024-09-21T05:10:34.686105+0000 mgr.y (mgr.14385) 415 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:36.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:35 smithi110 bash[22020]: cluster 2024-09-21T05:10:34.686105+0000 mgr.y (mgr.14385) 415 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:38.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:37 smithi089 bash[19831]: cluster 2024-09-21T05:10:36.687707+0000 mgr.y (mgr.14385) 416 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:37 smithi089 bash[26514]: cluster 2024-09-21T05:10:36.687707+0000 mgr.y (mgr.14385) 416 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:38.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:37 smithi110 bash[22020]: cluster 2024-09-21T05:10:36.687707+0000 mgr.y (mgr.14385) 416 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:38.201 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:39.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:38 smithi110 bash[22020]: audit 2024-09-21T05:10:38.295068+0000 mgr.y (mgr.14385) 417 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:39.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:38 smithi110 bash[22020]: cluster 2024-09-21T05:10:38.688419+0000 mgr.y (mgr.14385) 418 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:39.290 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:38 smithi089 bash[19831]: audit 2024-09-21T05:10:38.295068+0000 mgr.y (mgr.14385) 417 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:39.290 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:38 smithi089 bash[19831]: cluster 2024-09-21T05:10:38.688419+0000 mgr.y (mgr.14385) 418 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:39.290 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:38 smithi089 bash[26514]: audit 2024-09-21T05:10:38.295068+0000 mgr.y (mgr.14385) 417 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:39.291 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:38 smithi089 bash[26514]: cluster 2024-09-21T05:10:38.688419+0000 mgr.y (mgr.14385) 418 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: cluster: 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: id: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: health: HEALTH_OK 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: services: 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: mon: 3 daemons, quorum a,b,c (age 18m) 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: mgr: y(active, since 10m), standbys: x 2024-09-21T05:10:39.697 INFO:teuthology.orchestra.run.smithi089.stdout: osd: 8 osds: 8 up (since 11m), 8 in (since 11m) 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: data: 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: pools: 6 pools, 161 pgs 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: objects: 244 objects, 585 KiB 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: usage: 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: pgs: 161 active+clean 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: io: 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: client: 852 B/s rd, 0 op/s rd, 0 op/s wr 2024-09-21T05:10:39.698 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:10:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:39 smithi089 bash[19831]: audit 2024-09-21T05:10:39.701684+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.15.89:0/1384637356' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:10:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:39 smithi089 bash[26514]: audit 2024-09-21T05:10:39.701684+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.15.89:0/1384637356' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:10:40.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:39 smithi110 bash[22020]: audit 2024-09-21T05:10:39.701684+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.15.89:0/1384637356' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:10:40.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:10:41.292 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:40 smithi089 bash[26514]: audit 2024-09-21T05:10:40.517620+0000 mon.c (mon.2) 158 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:41.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:40 smithi089 bash[26514]: cluster 2024-09-21T05:10:40.689115+0000 mgr.y (mgr.14385) 419 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:41.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:40 smithi089 bash[19831]: audit 2024-09-21T05:10:40.517620+0000 mon.c (mon.2) 158 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:41.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:40 smithi089 bash[19831]: cluster 2024-09-21T05:10:40.689115+0000 mgr.y (mgr.14385) 419 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:41.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:40 smithi110 bash[22020]: audit 2024-09-21T05:10:40.517620+0000 mon.c (mon.2) 158 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:41.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:40 smithi110 bash[22020]: cluster 2024-09-21T05:10:40.689115+0000 mgr.y (mgr.14385) 419 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:42.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:41 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:41] "GET /metrics HTTP/1.1" 200 38153 "" "Prometheus/2.43.0" 2024-09-21T05:10:44.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:43 smithi089 bash[19831]: cluster 2024-09-21T05:10:42.690600+0000 mgr.y (mgr.14385) 420 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:44.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:43 smithi089 bash[26514]: cluster 2024-09-21T05:10:42.690600+0000 mgr.y (mgr.14385) 420 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:44.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:43 smithi110 bash[22020]: cluster 2024-09-21T05:10:42.690600+0000 mgr.y (mgr.14385) 420 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:45.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:44 smithi110 bash[22020]: cluster 2024-09-21T05:10:44.691222+0000 mgr.y (mgr.14385) 421 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:45.202 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:45.292 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:44 smithi089 bash[26514]: cluster 2024-09-21T05:10:44.691222+0000 mgr.y (mgr.14385) 421 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:45.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:44 smithi089 bash[19831]: cluster 2024-09-21T05:10:44.691222+0000 mgr.y (mgr.14385) 421 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:46.654 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:10:47.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:46 smithi089 bash[19831]: audit 2024-09-21T05:10:46.659007+0000 mon.c (mon.2) 159 : audit [DBG] from='client.? 172.21.15.89:0/1155474568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:10:47.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:46 smithi089 bash[26514]: audit 2024-09-21T05:10:46.659007+0000 mon.c (mon.2) 159 : audit [DBG] from='client.? 172.21.15.89:0/1155474568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:10:47.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:46 smithi110 bash[22020]: audit 2024-09-21T05:10:46.659007+0000 mon.c (mon.2) 159 : audit [DBG] from='client.? 172.21.15.89:0/1155474568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:10:47.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 2'"'"'' 2024-09-21T05:10:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:47 smithi089 bash[19831]: cluster 2024-09-21T05:10:46.692007+0000 mgr.y (mgr.14385) 422 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:47 smithi089 bash[26514]: cluster 2024-09-21T05:10:46.692007+0000 mgr.y (mgr.14385) 422 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:48.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:47 smithi110 bash[22020]: cluster 2024-09-21T05:10:46.692007+0000 mgr.y (mgr.14385) 422 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:49.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:48 smithi110 bash[22020]: audit 2024-09-21T05:10:48.306362+0000 mgr.y (mgr.14385) 423 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:49.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:48 smithi110 bash[22020]: cluster 2024-09-21T05:10:48.692754+0000 mgr.y (mgr.14385) 424 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:49.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:48 smithi089 bash[19831]: audit 2024-09-21T05:10:48.306362+0000 mgr.y (mgr.14385) 423 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:49.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:48 smithi089 bash[19831]: cluster 2024-09-21T05:10:48.692754+0000 mgr.y (mgr.14385) 424 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:49.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:48 smithi089 bash[26514]: audit 2024-09-21T05:10:48.306362+0000 mgr.y (mgr.14385) 423 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:49.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:48 smithi089 bash[26514]: cluster 2024-09-21T05:10:48.692754+0000 mgr.y (mgr.14385) 424 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:52.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:51 smithi089 bash[19831]: cluster 2024-09-21T05:10:50.693492+0000 mgr.y (mgr.14385) 425 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:52.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:10:51 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:10:51] "GET /metrics HTTP/1.1" 200 38153 "" "Prometheus/2.43.0" 2024-09-21T05:10:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:51 smithi089 bash[26514]: cluster 2024-09-21T05:10:50.693492+0000 mgr.y (mgr.14385) 425 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:52.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:51 smithi110 bash[22020]: cluster 2024-09-21T05:10:50.693492+0000 mgr.y (mgr.14385) 425 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:52.100 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:53.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:52 smithi089 bash[19831]: cluster 2024-09-21T05:10:52.694420+0000 mgr.y (mgr.14385) 426 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:53.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:52 smithi089 bash[26514]: cluster 2024-09-21T05:10:52.694420+0000 mgr.y (mgr.14385) 426 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:53.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:52 smithi110 bash[22020]: cluster 2024-09-21T05:10:52.694420+0000 mgr.y (mgr.14385) 426 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:53.531 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:10:53.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:53 smithi089 bash[19831]: audit 2024-09-21T05:10:53.522482+0000 mon.c (mon.2) 160 : audit [DBG] from='client.? 172.21.15.89:0/2350329241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:53.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:53 smithi089 bash[26514]: audit 2024-09-21T05:10:53.522482+0000 mon.c (mon.2) 160 : audit [DBG] from='client.? 172.21.15.89:0/2350329241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:54.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:53 smithi110 bash[22020]: audit 2024-09-21T05:10:53.522482+0000 mon.c (mon.2) 160 : audit [DBG] from='client.? 172.21.15.89:0/2350329241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:10:54.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph mgr fail' 2024-09-21T05:10:55.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:54 smithi089 bash[19831]: cluster 2024-09-21T05:10:54.695115+0000 mgr.y (mgr.14385) 427 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:55.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:54 smithi089 bash[26514]: cluster 2024-09-21T05:10:54.695115+0000 mgr.y (mgr.14385) 427 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:55.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:54 smithi110 bash[22020]: cluster 2024-09-21T05:10:54.695115+0000 mgr.y (mgr.14385) 427 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:55 smithi089 bash[19831]: audit 2024-09-21T05:10:55.518548+0000 mon.c (mon.2) 161 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:55 smithi089 bash[26514]: audit 2024-09-21T05:10:55.518548+0000 mon.c (mon.2) 161 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:56.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:55 smithi110 bash[22020]: audit 2024-09-21T05:10:55.518548+0000 mon.c (mon.2) 161 : audit [DBG] from='mgr.14385 172.21.15.89:0/863679845' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:10:57.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:56 smithi089 bash[19831]: cluster 2024-09-21T05:10:56.696730+0000 mgr.y (mgr.14385) 428 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:57.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:56 smithi089 bash[26514]: cluster 2024-09-21T05:10:56.696730+0000 mgr.y (mgr.14385) 428 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:57.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:56 smithi110 bash[22020]: cluster 2024-09-21T05:10:56.696730+0000 mgr.y (mgr.14385) 428 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:10:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:10:59.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:58 smithi110 bash[22020]: audit 2024-09-21T05:10:58.317533+0000 mgr.y (mgr.14385) 429 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:59.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:10:58 smithi110 bash[22020]: cluster 2024-09-21T05:10:58.697427+0000 mgr.y (mgr.14385) 430 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:59.066 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:58 smithi089 bash[19831]: audit 2024-09-21T05:10:58.317533+0000 mgr.y (mgr.14385) 429 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:59.067 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:10:58 smithi089 bash[19831]: cluster 2024-09-21T05:10:58.697427+0000 mgr.y (mgr.14385) 430 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:10:59.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:58 smithi089 bash[26514]: audit 2024-09-21T05:10:58.317533+0000 mgr.y (mgr.14385) 429 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:10:59.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:10:58 smithi089 bash[26514]: cluster 2024-09-21T05:10:58.697427+0000 mgr.y (mgr.14385) 430 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.402796+0000 mon.a (mon.0) 919 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: cluster 2024-09-21T05:11:00.403357+0000 mon.a (mon.0) 920 : cluster [INF] Activating manager daemon x 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.407491+0000 mon.a (mon.0) 921 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: cluster 2024-09-21T05:11:00.415110+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: cluster 2024-09-21T05:11:00.415672+0000 mon.a (mon.0) 923 : cluster [DBG] mgrmap e23: x(active, starting, since 0.0123093s) 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.423421+0000 mon.a (mon.0) 924 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.423543+0000 mon.a (mon.0) 925 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.423646+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:11:00.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.425697+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.426179+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.426414+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.426572+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.426728+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.426879+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.427030+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.427178+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.427326+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.430456+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.430570+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:11:00.755 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[22020]: audit 2024-09-21T05:11:00.430982+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:11:00.756 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[50043]: [21/Sep/2024:05:11:00] ENGINE Bus STOPPING 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[20084]: debug 2024-09-21T05:11:00.414+0000 7f4135af1640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[20084]: ignoring --setuser ceph since I am not root 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[20084]: ignoring --setgroup ceph since I am not root 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[20084]: debug 2024-09-21T05:11:00.582+0000 7f1cfa09a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.402796+0000 mon.a (mon.0) 919 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: cluster 2024-09-21T05:11:00.403357+0000 mon.a (mon.0) 920 : cluster [INF] Activating manager daemon x 2024-09-21T05:11:00.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.407491+0000 mon.a (mon.0) 921 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: cluster 2024-09-21T05:11:00.415110+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: cluster 2024-09-21T05:11:00.415672+0000 mon.a (mon.0) 923 : cluster [DBG] mgrmap e23: x(active, starting, since 0.0123093s) 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.423421+0000 mon.a (mon.0) 924 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.423543+0000 mon.a (mon.0) 925 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.423646+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.425697+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.426179+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.426414+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.426572+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.426728+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.426879+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:11:00.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.427030+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.427178+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.427326+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.430456+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.430570+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[26514]: audit 2024-09-21T05:11:00.430982+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.402796+0000 mon.a (mon.0) 919 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: cluster 2024-09-21T05:11:00.403357+0000 mon.a (mon.0) 920 : cluster [INF] Activating manager daemon x 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.407491+0000 mon.a (mon.0) 921 : audit [INF] from='client.? 172.21.15.89:0/1679160879' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: cluster 2024-09-21T05:11:00.415110+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: cluster 2024-09-21T05:11:00.415672+0000 mon.a (mon.0) 923 : cluster [DBG] mgrmap e23: x(active, starting, since 0.0123093s) 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.423421+0000 mon.a (mon.0) 924 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:11:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.423543+0000 mon.a (mon.0) 925 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.423646+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.425697+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.426179+0000 mon.a (mon.0) 928 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.426414+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.426572+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.426728+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.426879+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:11:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.427030+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:11:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.427178+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:11:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.427326+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:11:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.430456+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:11:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.430570+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:11:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:00 smithi089 bash[19831]: audit 2024-09-21T05:11:00.430982+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:11:01.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[50043]: [21/Sep/2024:05:11:00] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:11:01.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:00 smithi110 bash[50043]: [21/Sep/2024:05:11:00] ENGINE Bus STOPPED 2024-09-21T05:11:01.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:11:01.791 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:01 smithi089 bash[19831]: cluster 2024-09-21T05:11:00.768443+0000 mon.a (mon.0) 939 : cluster [INF] Manager daemon x is now available 2024-09-21T05:11:01.791 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:01 smithi089 bash[26514]: cluster 2024-09-21T05:11:00.768443+0000 mon.a (mon.0) 939 : cluster [INF] Manager daemon x is now available 2024-09-21T05:11:01.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:01 smithi110 bash[22020]: cluster 2024-09-21T05:11:00.768443+0000 mon.a (mon.0) 939 : cluster [INF] Manager daemon x is now available 2024-09-21T05:11:02.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:01 smithi089 bash[20084]: debug 2024-09-21T05:11:01.790+0000 7f1cfa09a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-21T05:11:02.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:01 smithi089 bash[20084]: debug 2024-09-21T05:11:01.854+0000 7f1cfa09a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T05:11:02.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[20084]: debug 2024-09-21T05:11:02.002+0000 7f1cfa09a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T05:11:02.735 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[20084]: debug 2024-09-21T05:11:02.661+0000 7f1cfa09a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T05:11:02.735 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[19831]: cluster 2024-09-21T05:11:01.474654+0000 mon.a (mon.0) 940 : cluster [DBG] mgrmap e24: x(active, since 1.07125s) 2024-09-21T05:11:02.735 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[19831]: cluster 2024-09-21T05:11:01.488846+0000 mgr.x (mgr.24436) 1 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:02.735 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[26514]: cluster 2024-09-21T05:11:01.474654+0000 mon.a (mon.0) 940 : cluster [DBG] mgrmap e24: x(active, since 1.07125s) 2024-09-21T05:11:02.735 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[26514]: cluster 2024-09-21T05:11:01.488846+0000 mgr.x (mgr.24436) 1 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:02.761 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:02 smithi110 bash[50043]: [21/Sep/2024:05:11:02] ENGINE Bus STARTING 2024-09-21T05:11:02.761 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:02 smithi110 bash[22020]: cluster 2024-09-21T05:11:01.474654+0000 mon.a (mon.0) 940 : cluster [DBG] mgrmap e24: x(active, since 1.07125s) 2024-09-21T05:11:02.761 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:02 smithi110 bash[22020]: cluster 2024-09-21T05:11:01.488846+0000 mgr.x (mgr.24436) 1 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:02.992 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[20084]: debug 2024-09-21T05:11:02.733+0000 7f1cfa09a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T05:11:02.992 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[20084]: debug 2024-09-21T05:11:02.801+0000 7f1cfa09a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T05:11:03.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:02 smithi110 bash[50043]: [21/Sep/2024:05:11:02] ENGINE Serving on http://:::9283 2024-09-21T05:11:03.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:02 smithi110 bash[50043]: [21/Sep/2024:05:11:02] ENGINE Bus STARTED 2024-09-21T05:11:03.293 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:02 smithi089 bash[20084]: debug 2024-09-21T05:11:02.989+0000 7f1cfa09a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-21T05:11:03.293 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.069+0000 7f1cfa09a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T05:11:03.293 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.141+0000 7f1cfa09a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T05:11:03.669 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.401+0000 7f1cfa09a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T05:11:03.669 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.469+0000 7f1cfa09a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T05:11:03.669 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: cluster 2024-09-21T05:11:02.428705+0000 mgr.x (mgr.24436) 2 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.625180+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.631061+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.652430+0000 mgr.x (mgr.24436) 3 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.653104+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.653542+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.679472+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[19831]: audit 2024-09-21T05:11:02.697551+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: cluster 2024-09-21T05:11:02.428705+0000 mgr.x (mgr.24436) 2 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.625180+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:03.670 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.631061+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:03.671 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.652430+0000 mgr.x (mgr.24436) 3 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:03.671 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.653104+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:03.671 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.653542+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:03.671 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.679472+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:11:03.671 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[26514]: audit 2024-09-21T05:11:02.697551+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:11:03.999 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.665+0000 7f1cfa09a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T05:11:03.999 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:03 smithi089 bash[20084]: debug 2024-09-21T05:11:03.745+0000 7f1cfa09a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T05:11:04.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: cluster 2024-09-21T05:11:02.428705+0000 mgr.x (mgr.24436) 2 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:04.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.625180+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.631061+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.652430+0000 mgr.x (mgr.24436) 3 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.653104+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.653542+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.679472+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:11:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[22020]: audit 2024-09-21T05:11:02.697551+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:11:04.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: debug 2024-09-21T05:11:03.771+0000 7f2db69e9640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:11:03] ENGINE Error in HTTPServer.serve 2024-09-21T05:11:04.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: Traceback (most recent call last): 2024-09-21T05:11:04.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:11:04.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: self._connections.run(self.expiration_interval) 2024-09-21T05:11:04.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: self._run(expiration_interval) 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:11:04.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: s = self.context.wrap_socket( 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: return self.sslsocket_class._create( 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: self.do_handshake() 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:11:04.057 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: self._sslobj.do_handshake() 2024-09-21T05:11:04.058 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:03 smithi110 bash[50043]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:11:04.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[20084]: debug 2024-09-21T05:11:03.997+0000 7f1cfa09a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T05:11:04.292 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[20084]: debug 2024-09-21T05:11:04.173+0000 7f1cfa09a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:11:04.601 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[20084]: debug 2024-09-21T05:11:04.337+0000 7f1cfa09a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T05:11:04.601 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[20084]: debug 2024-09-21T05:11:04.421+0000 7f1cfa09a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T05:11:04.601 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[20084]: debug 2024-09-21T05:11:04.601+0000 7f1cfa09a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.112601+0000 mgr.x (mgr.24436) 4 : cephadm [INF] Deploying cephadm binary to smithi110 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.130637+0000 mgr.x (mgr.24436) 5 : cephadm [INF] Deploying cephadm binary to smithi089 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.394474+0000 mgr.x (mgr.24436) 6 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTING 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.526979+0000 mgr.x (mgr.24436) 7 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cluster 2024-09-21T05:11:03.646069+0000 mon.a (mon.0) 947 : cluster [DBG] mgrmap e25: x(active, since 3s) 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.751654+0000 mgr.x (mgr.24436) 8 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.751919+0000 mgr.x (mgr.24436) 9 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTED 2024-09-21T05:11:05.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: cephadm 2024-09-21T05:11:03.775440+0000 mgr.x (mgr.24436) 10 : cephadm [ERR] [21/Sep/2024:05:11:03] ENGINE Error in HTTPServer.serve 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: Traceback (most recent call last): 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: self._connections.run(self.expiration_interval) 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: self._run(expiration_interval) 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: s = self.context.wrap_socket( 2024-09-21T05:11:05.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: return self.sslsocket_class._create( 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: self.do_handshake() 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: self._sslobj.do_handshake() 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[26514]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.112601+0000 mgr.x (mgr.24436) 4 : cephadm [INF] Deploying cephadm binary to smithi110 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.130637+0000 mgr.x (mgr.24436) 5 : cephadm [INF] Deploying cephadm binary to smithi089 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.394474+0000 mgr.x (mgr.24436) 6 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTING 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.526979+0000 mgr.x (mgr.24436) 7 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:11:05.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cluster 2024-09-21T05:11:03.646069+0000 mon.a (mon.0) 947 : cluster [DBG] mgrmap e25: x(active, since 3s) 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.751654+0000 mgr.x (mgr.24436) 8 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.751919+0000 mgr.x (mgr.24436) 9 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTED 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: cephadm 2024-09-21T05:11:03.775440+0000 mgr.x (mgr.24436) 10 : cephadm [ERR] [21/Sep/2024:05:11:03] ENGINE Error in HTTPServer.serve 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:11:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: self.do_handshake() 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T05:11:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:04 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:11:05.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.112601+0000 mgr.x (mgr.24436) 4 : cephadm [INF] Deploying cephadm binary to smithi110 2024-09-21T05:11:05.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.130637+0000 mgr.x (mgr.24436) 5 : cephadm [INF] Deploying cephadm binary to smithi089 2024-09-21T05:11:05.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.394474+0000 mgr.x (mgr.24436) 6 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTING 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.526979+0000 mgr.x (mgr.24436) 7 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cluster 2024-09-21T05:11:03.646069+0000 mon.a (mon.0) 947 : cluster [DBG] mgrmap e25: x(active, since 3s) 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.751654+0000 mgr.x (mgr.24436) 8 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.751919+0000 mgr.x (mgr.24436) 9 : cephadm [INF] [21/Sep/2024:05:11:03] ENGINE Bus STARTED 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: cephadm 2024-09-21T05:11:03.775440+0000 mgr.x (mgr.24436) 10 : cephadm [ERR] [21/Sep/2024:05:11:03] ENGINE Error in HTTPServer.serve 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: Traceback (most recent call last): 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: self._connections.run(self.expiration_interval) 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: self._run(expiration_interval) 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:11:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: s = self.context.wrap_socket( 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: return self.sslsocket_class._create( 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: self.do_handshake() 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: self._sslobj.do_handshake() 2024-09-21T05:11:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:04 smithi110 bash[22020]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:11:05.764 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[26514]: cluster 2024-09-21T05:11:04.429304+0000 mgr.x (mgr.24436) 11 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:05.764 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[19831]: cluster 2024-09-21T05:11:04.429304+0000 mgr.x (mgr.24436) 11 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:05.764 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[20084]: debug 2024-09-21T05:11:05.449+0000 7f1cfa09a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T05:11:05.764 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[20084]: debug 2024-09-21T05:11:05.529+0000 7f1cfa09a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T05:11:05.881 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:11:06.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[20084]: debug 2024-09-21T05:11:05.761+0000 7f1cfa09a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T05:11:06.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:05 smithi089 bash[20084]: debug 2024-09-21T05:11:05.837+0000 7f1cfa09a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T05:11:06.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:05 smithi110 bash[22020]: cluster 2024-09-21T05:11:04.429304+0000 mgr.x (mgr.24436) 11 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:06.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: debug 2024-09-21T05:11:06.249+0000 7f1cfa09a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T05:11:06.542 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: debug 2024-09-21T05:11:06.329+0000 7f1cfa09a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T05:11:06.543 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: [21/Sep/2024:05:11:06] ENGINE Bus STARTING 2024-09-21T05:11:06.543 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: CherryPy Checker: 2024-09-21T05:11:06.543 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: The Application mounted at '' has an empty config. 2024-09-21T05:11:06.543 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: [21/Sep/2024:05:11:06] ENGINE Serving on http://:::9283 2024-09-21T05:11:06.543 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[20084]: [21/Sep/2024:05:11:06] ENGINE Bus STARTED 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: cluster 2024-09-21T05:11:05.658822+0000 mon.a (mon.0) 948 : cluster [DBG] mgrmap e26: x(active, since 5s) 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:05.908021+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:05.914490+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: cluster 2024-09-21T05:11:06.359796+0000 mon.a (mon.0) 951 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:06.364170+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:06.366690+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:06.370457+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:11:07.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[19831]: audit 2024-09-21T05:11:06.370845+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: cluster 2024-09-21T05:11:05.658822+0000 mon.a (mon.0) 948 : cluster [DBG] mgrmap e26: x(active, since 5s) 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:05.908021+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:05.914490+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: cluster 2024-09-21T05:11:06.359796+0000 mon.a (mon.0) 951 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:06.364170+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:06.366690+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:06.370457+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:11:07.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:06 smithi089 bash[26514]: audit 2024-09-21T05:11:06.370845+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: cluster 2024-09-21T05:11:05.658822+0000 mon.a (mon.0) 948 : cluster [DBG] mgrmap e26: x(active, since 5s) 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:05.908021+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:05.914490+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: cluster 2024-09-21T05:11:06.359796+0000 mon.a (mon.0) 951 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:06.364170+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:06.366690+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:06.370457+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:11:07.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:06 smithi110 bash[22020]: audit 2024-09-21T05:11:06.370845+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.? 172.21.15.89:0/1463311257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:11:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[19831]: cluster 2024-09-21T05:11:06.429976+0000 mgr.x (mgr.24436) 12 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[19831]: cluster 2024-09-21T05:11:06.931757+0000 mon.a (mon.0) 956 : cluster [DBG] mgrmap e27: x(active, since 6s), standbys: y 2024-09-21T05:11:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[19831]: audit 2024-09-21T05:11:06.932424+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:11:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[26514]: cluster 2024-09-21T05:11:06.429976+0000 mgr.x (mgr.24436) 12 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[26514]: cluster 2024-09-21T05:11:06.931757+0000 mon.a (mon.0) 956 : cluster [DBG] mgrmap e27: x(active, since 6s), standbys: y 2024-09-21T05:11:08.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:07 smithi089 bash[26514]: audit 2024-09-21T05:11:06.932424+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:11:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:07 smithi110 bash[22020]: cluster 2024-09-21T05:11:06.429976+0000 mgr.x (mgr.24436) 12 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:11:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:07 smithi110 bash[22020]: cluster 2024-09-21T05:11:06.931757+0000 mon.a (mon.0) 956 : cluster [DBG] mgrmap e27: x(active, since 6s), standbys: y 2024-09-21T05:11:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:07 smithi110 bash[22020]: audit 2024-09-21T05:11:06.932424+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:11:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:09 smithi089 bash[19831]: audit 2024-09-21T05:11:08.326932+0000 mgr.x (mgr.24436) 13 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:09 smithi089 bash[19831]: cluster 2024-09-21T05:11:08.431683+0000 mgr.x (mgr.24436) 14 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:11:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:09 smithi089 bash[26514]: audit 2024-09-21T05:11:08.326932+0000 mgr.x (mgr.24436) 13 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:09 smithi089 bash[26514]: cluster 2024-09-21T05:11:08.431683+0000 mgr.x (mgr.24436) 14 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:11:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:09 smithi110 bash[22020]: audit 2024-09-21T05:11:08.326932+0000 mgr.x (mgr.24436) 13 : audit [DBG] from='client.14814 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:09 smithi110 bash[22020]: cluster 2024-09-21T05:11:08.431683+0000 mgr.x (mgr.24436) 14 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:11:11.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:10 smithi110 bash[47732]: ts=2024-09-21T05:11:10.721Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:11:11.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:10 smithi110 bash[47732]: ts=2024-09-21T05:11:10.723Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:11:11.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:10 smithi110 bash[47732]: ts=2024-09-21T05:11:10.724Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:11:11.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:10 smithi110 bash[47732]: ts=2024-09-21T05:11:10.725Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:11:11.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:10 smithi110 bash[47732]: ts=2024-09-21T05:11:10.725Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:11:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[19831]: cluster 2024-09-21T05:11:10.432155+0000 mgr.x (mgr.24436) 15 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:11:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[19831]: audit 2024-09-21T05:11:11.292782+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[19831]: audit 2024-09-21T05:11:11.297973+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:12.044 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[20084]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:11:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-21T05:11:12.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[26514]: cluster 2024-09-21T05:11:10.432155+0000 mgr.x (mgr.24436) 15 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:11:12.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[26514]: audit 2024-09-21T05:11:11.292782+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:12.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:11 smithi089 bash[26514]: audit 2024-09-21T05:11:11.297973+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:12.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:11 smithi110 bash[22020]: cluster 2024-09-21T05:11:10.432155+0000 mgr.x (mgr.24436) 15 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:11:12.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:11 smithi110 bash[22020]: audit 2024-09-21T05:11:11.292782+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:12.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:11 smithi110 bash[22020]: audit 2024-09-21T05:11:11.297973+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:11.685384+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:11.691562+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.419371+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.429821+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.433212+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.434890+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.437388+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.438826+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:12 smithi110 bash[22020]: audit 2024-09-21T05:11:12.446181+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:11.685384+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:11.691562+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.419371+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.429821+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.433212+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.434890+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.437388+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.438826+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[19831]: audit 2024-09-21T05:11:12.446181+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:11.685384+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:11.691562+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.419371+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.429821+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.433212+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.434890+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.437388+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.438826+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:13.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:12 smithi089 bash[26514]: audit 2024-09-21T05:11:12.446181+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:13.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[47061]: logger=cleanup t=2024-09-21T05:11:13.04063133Z level=info msg="Completed cleanup jobs" duration=4.544224ms 2024-09-21T05:11:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: cluster 2024-09-21T05:11:12.432958+0000 mgr.x (mgr.24436) 16 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:11:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.438143+0000 mgr.x (mgr.24436) 17 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 3292M 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.756917+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.763280+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.766955+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.768568+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.770128+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.770973+0000 mgr.x (mgr.24436) 18 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 3036M 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.771730+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.775934+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.778857+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:12.780093+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.780095+0000 mgr.x (mgr.24436) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.780439+0000 mgr.x (mgr.24436) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.182838+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.189256+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.195292+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.201449+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.206649+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.236048+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[19831]: audit 2024-09-21T05:11:13.253298+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: cluster 2024-09-21T05:11:12.432958+0000 mgr.x (mgr.24436) 16 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.438143+0000 mgr.x (mgr.24436) 17 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 3292M 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.756917+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.763280+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.766955+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.768568+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.770128+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.770973+0000 mgr.x (mgr.24436) 18 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 3036M 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.771730+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.775934+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.778857+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:12.780093+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.780095+0000 mgr.x (mgr.24436) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.780439+0000 mgr.x (mgr.24436) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.182838+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.189256+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.195292+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.201449+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.206649+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.236048+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:11:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:13 smithi089 bash[26514]: audit 2024-09-21T05:11:13.253298+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:14.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: cluster 2024-09-21T05:11:12.432958+0000 mgr.x (mgr.24436) 16 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:11:14.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.438143+0000 mgr.x (mgr.24436) 17 : cephadm [INF] Adjusting osd_memory_target on smithi110 to 3292M 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.756917+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.763280+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.766955+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.768568+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.770128+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.770973+0000 mgr.x (mgr.24436) 18 : cephadm [INF] Adjusting osd_memory_target on smithi089 to 3036M 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.771730+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.775934+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.778857+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:12.780093+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.780095+0000 mgr.x (mgr.24436) 19 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:11:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.780439+0000 mgr.x (mgr.24436) 20 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.182838+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.189256+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.195292+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.201449+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.206649+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.236048+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:11:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:13 smithi110 bash[22020]: audit 2024-09-21T05:11:13.253298+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.920573+0000 mgr.x (mgr.24436) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:12.920888+0000 mgr.x (mgr.24436) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.013571+0000 mgr.x (mgr.24436) 23 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.013856+0000 mgr.x (mgr.24436) 24 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.096446+0000 mgr.x (mgr.24436) 25 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.101987+0000 mgr.x (mgr.24436) 26 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.233287+0000 mgr.x (mgr.24436) 27 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:11:15.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[19831]: cephadm 2024-09-21T05:11:13.253180+0000 mgr.x (mgr.24436) 28 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.920573+0000 mgr.x (mgr.24436) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:12.920888+0000 mgr.x (mgr.24436) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.013571+0000 mgr.x (mgr.24436) 23 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.013856+0000 mgr.x (mgr.24436) 24 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.096446+0000 mgr.x (mgr.24436) 25 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.101987+0000 mgr.x (mgr.24436) 26 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.233287+0000 mgr.x (mgr.24436) 27 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:11:15.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:14 smithi089 bash[26514]: cephadm 2024-09-21T05:11:13.253180+0000 mgr.x (mgr.24436) 28 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.920573+0000 mgr.x (mgr.24436) 21 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:12.920888+0000 mgr.x (mgr.24436) 22 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.013571+0000 mgr.x (mgr.24436) 23 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.013856+0000 mgr.x (mgr.24436) 24 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.096446+0000 mgr.x (mgr.24436) 25 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.101987+0000 mgr.x (mgr.24436) 26 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.233287+0000 mgr.x (mgr.24436) 27 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:11:15.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:14 smithi110 bash[22020]: cephadm 2024-09-21T05:11:13.253180+0000 mgr.x (mgr.24436) 28 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:11:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:15 smithi089 bash[19831]: cluster 2024-09-21T05:11:14.433635+0000 mgr.x (mgr.24436) 29 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:15.983 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:15 smithi089 bash[26514]: cluster 2024-09-21T05:11:14.433635+0000 mgr.x (mgr.24436) 29 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:16.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:15 smithi110 bash[22020]: cluster 2024-09-21T05:11:14.433635+0000 mgr.x (mgr.24436) 29 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:17.508 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[19831]: audit 2024-09-21T05:11:16.274889+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.508 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[19831]: audit 2024-09-21T05:11:16.281276+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.508 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[19831]: cephadm 2024-09-21T05:11:16.282775+0000 mgr.x (mgr.24436) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:11:17.509 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[19831]: cluster 2024-09-21T05:11:16.434311+0000 mgr.x (mgr.24436) 31 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:17.509 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[19831]: cephadm 2024-09-21T05:11:16.581096+0000 mgr.x (mgr.24436) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:11:17.509 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[26514]: audit 2024-09-21T05:11:16.274889+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.509 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[26514]: audit 2024-09-21T05:11:16.281276+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.509 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[26514]: cephadm 2024-09-21T05:11:16.282775+0000 mgr.x (mgr.24436) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:11:17.510 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[26514]: cluster 2024-09-21T05:11:16.434311+0000 mgr.x (mgr.24436) 31 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:17.510 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:17 smithi089 bash[26514]: cephadm 2024-09-21T05:11:16.581096+0000 mgr.x (mgr.24436) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:11:17.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:17 smithi110 bash[22020]: audit 2024-09-21T05:11:16.274889+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:17 smithi110 bash[22020]: audit 2024-09-21T05:11:16.281276+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:17.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:17 smithi110 bash[22020]: cephadm 2024-09-21T05:11:16.282775+0000 mgr.x (mgr.24436) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:11:17.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:17 smithi110 bash[22020]: cluster 2024-09-21T05:11:16.434311+0000 mgr.x (mgr.24436) 31 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:11:17.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:17 smithi110 bash[22020]: cephadm 2024-09-21T05:11:16.581096+0000 mgr.x (mgr.24436) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:11:18.542 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[19831]: audit 2024-09-21T05:11:17.653881+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:18.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[19831]: audit 2024-09-21T05:11:17.800376+0000 mon.c (mon.2) 162 : audit [DBG] from='client.? 172.21.15.89:0/2016523652' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:11:18.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[19831]: audit 2024-09-21T05:11:18.101316+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]: dispatch 2024-09-21T05:11:18.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[26514]: audit 2024-09-21T05:11:17.653881+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:18.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[26514]: audit 2024-09-21T05:11:17.800376+0000 mon.c (mon.2) 162 : audit [DBG] from='client.? 172.21.15.89:0/2016523652' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:11:18.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:18 smithi089 bash[26514]: audit 2024-09-21T05:11:18.101316+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]: dispatch 2024-09-21T05:11:18.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:18 smithi110 bash[22020]: audit 2024-09-21T05:11:17.653881+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:18.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:18 smithi110 bash[22020]: audit 2024-09-21T05:11:17.800376+0000 mon.c (mon.2) 162 : audit [DBG] from='client.? 172.21.15.89:0/2016523652' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:11:18.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:18 smithi110 bash[22020]: audit 2024-09-21T05:11:18.101316+0000 mon.a (mon.0) 988 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]: dispatch 2024-09-21T05:11:19.474 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:19 smithi110 bash[22020]: audit 2024-09-21T05:11:18.283333+0000 mon.a (mon.0) 989 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]': finished 2024-09-21T05:11:19.475 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:19 smithi110 bash[22020]: cluster 2024-09-21T05:11:18.289435+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-21T05:11:19.475 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:19 smithi110 bash[22020]: cluster 2024-09-21T05:11:18.434939+0000 mgr.x (mgr.24436) 33 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:11:19.475 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:19 smithi110 bash[22020]: audit 2024-09-21T05:11:18.595856+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.89:0/3736885279' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:19.475 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:19 smithi110 bash[22020]: audit 2024-09-21T05:11:18.596872+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:19.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[19831]: audit 2024-09-21T05:11:18.283333+0000 mon.a (mon.0) 989 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]': finished 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[19831]: cluster 2024-09-21T05:11:18.289435+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[19831]: cluster 2024-09-21T05:11:18.434939+0000 mgr.x (mgr.24436) 33 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[19831]: audit 2024-09-21T05:11:18.595856+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.89:0/3736885279' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[19831]: audit 2024-09-21T05:11:18.596872+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[26514]: audit 2024-09-21T05:11:18.283333+0000 mon.a (mon.0) 989 : audit [INF] from='client.? 172.21.15.89:0/2587268646' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/765286783"}]': finished 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[26514]: cluster 2024-09-21T05:11:18.289435+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[26514]: cluster 2024-09-21T05:11:18.434939+0000 mgr.x (mgr.24436) 33 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:11:19.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[26514]: audit 2024-09-21T05:11:18.595856+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.89:0/3736885279' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:19.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:19 smithi089 bash[26514]: audit 2024-09-21T05:11:18.596872+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]: dispatch 2024-09-21T05:11:20.453 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[22020]: audit 2024-09-21T05:11:19.308675+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]': finished 2024-09-21T05:11:20.453 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[22020]: cluster 2024-09-21T05:11:19.317659+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-21T05:11:20.453 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[22020]: audit 2024-09-21T05:11:19.642653+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.89:0/3165561123' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:20.453 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[22020]: audit 2024-09-21T05:11:19.643683+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[19831]: audit 2024-09-21T05:11:19.308675+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]': finished 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[19831]: cluster 2024-09-21T05:11:19.317659+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[19831]: audit 2024-09-21T05:11:19.642653+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.89:0/3165561123' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[19831]: audit 2024-09-21T05:11:19.643683+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[26514]: audit 2024-09-21T05:11:19.308675+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/765286783"}]': finished 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[26514]: cluster 2024-09-21T05:11:19.317659+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[26514]: audit 2024-09-21T05:11:19.642653+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.89:0/3165561123' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:20.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:20 smithi089 bash[26514]: audit 2024-09-21T05:11:19.643683+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]: dispatch 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:11:21.119 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:11:21.120 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.933Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:11:21.120 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.934Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:11:21.120 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.934Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:11:21.120 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.934Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:11:21.120 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:20 smithi110 bash[47732]: ts=2024-09-21T05:11:20.934Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:11:21.415 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[22020]: audit 2024-09-21T05:11:20.311082+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]': finished 2024-09-21T05:11:21.415 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[22020]: cluster 2024-09-21T05:11:20.320514+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-21T05:11:21.415 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[22020]: cluster 2024-09-21T05:11:20.435634+0000 mgr.x (mgr.24436) 34 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T05:11:21.415 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[22020]: audit 2024-09-21T05:11:20.645655+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]: dispatch 2024-09-21T05:11:21.721 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[51772]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:11:21.721 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:21 smithi110 bash[51833]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:11:21.721 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:21 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:11:21.721 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:21 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:11:21.721 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:21 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[19831]: audit 2024-09-21T05:11:20.311082+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]': finished 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[19831]: cluster 2024-09-21T05:11:20.320514+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[19831]: cluster 2024-09-21T05:11:20.435634+0000 mgr.x (mgr.24436) 34 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[19831]: audit 2024-09-21T05:11:20.645655+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]: dispatch 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[26514]: audit 2024-09-21T05:11:20.311082+0000 mon.a (mon.0) 995 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2668596417"}]': finished 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[26514]: cluster 2024-09-21T05:11:20.320514+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[26514]: cluster 2024-09-21T05:11:20.435634+0000 mgr.x (mgr.24436) 34 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-21T05:11:21.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:21 smithi089 bash[26514]: audit 2024-09-21T05:11:20.645655+0000 mon.a (mon.0) 997 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]: dispatch 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.333418+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]': finished 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: cluster 2024-09-21T05:11:21.342182+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.658582+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.659659+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]: dispatch 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.665839+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.669214+0000 mgr.x (mgr.24436) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.668 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.670269+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.668 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.674562+0000 mgr.x (mgr.24436) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.668 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.675708+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.668 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.680530+0000 mgr.x (mgr.24436) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:22.668 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[22020]: audit 2024-09-21T05:11:21.681550+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:22.672 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.333418+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]': finished 2024-09-21T05:11:22.672 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: cluster 2024-09-21T05:11:21.342182+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-21T05:11:22.672 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.658582+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.659659+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.665839+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.669214+0000 mgr.x (mgr.24436) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.670269+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.674562+0000 mgr.x (mgr.24436) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.675708+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.680530+0000 mgr.x (mgr.24436) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:22.673 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[19831]: audit 2024-09-21T05:11:21.681550+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:22.674 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.333418+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.89:0/2219452619' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/1021589063"}]': finished 2024-09-21T05:11:22.674 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: cluster 2024-09-21T05:11:21.342182+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-09-21T05:11:22.674 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.658582+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.674 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.659659+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.665839+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.669214+0000 mgr.x (mgr.24436) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.670269+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.674562+0000 mgr.x (mgr.24436) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.675708+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.680530+0000 mgr.x (mgr.24436) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:22.675 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:22 smithi089 bash[26514]: audit 2024-09-21T05:11:21.681550+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:11:23.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.778Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:11:23.053 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.778Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.778Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.778Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.778Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.779Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.780Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.781Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.781Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.783Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.783Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.942µs 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.783Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.784Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.800Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-09-21T05:11:23.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.800Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.800Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=30.134µs wal_replay_duration=16.74829ms wbl_replay_duration=124ns total_replay_duration=16.810239ms 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.802Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.802Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.802Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.826Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=24.244313ms db_storage=900ns remote_storage=1.16µs web_handler=390ns query_engine=628ns scrape=305.122µs scrape_sd=141.906µs notify=17.557µs notify_sd=18.932µs rules=23.370844ms tracing=6.406µs 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.826Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:11:23.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:11:22 smithi110 bash[51860]: ts=2024-09-21T05:11:22.826Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:11:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[26514]: cluster 2024-09-21T05:11:22.437296+0000 mgr.x (mgr.24436) 38 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 986 B/s rd, 1 op/s 2024-09-21T05:11:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[26514]: audit 2024-09-21T05:11:22.657304+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]': finished 2024-09-21T05:11:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[26514]: cluster 2024-09-21T05:11:22.664739+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-21T05:11:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[26514]: audit 2024-09-21T05:11:22.981112+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]: dispatch 2024-09-21T05:11:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[19831]: cluster 2024-09-21T05:11:22.437296+0000 mgr.x (mgr.24436) 38 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 986 B/s rd, 1 op/s 2024-09-21T05:11:24.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[19831]: audit 2024-09-21T05:11:22.657304+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]': finished 2024-09-21T05:11:24.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[19831]: cluster 2024-09-21T05:11:22.664739+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-21T05:11:24.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:23 smithi089 bash[19831]: audit 2024-09-21T05:11:22.981112+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]: dispatch 2024-09-21T05:11:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:23 smithi110 bash[22020]: cluster 2024-09-21T05:11:22.437296+0000 mgr.x (mgr.24436) 38 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 986 B/s rd, 1 op/s 2024-09-21T05:11:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:23 smithi110 bash[22020]: audit 2024-09-21T05:11:22.657304+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? 172.21.15.89:0/4153888707' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4083140151"}]': finished 2024-09-21T05:11:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:23 smithi110 bash[22020]: cluster 2024-09-21T05:11:22.664739+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-09-21T05:11:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:23 smithi110 bash[22020]: audit 2024-09-21T05:11:22.981112+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]: dispatch 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[19831]: audit 2024-09-21T05:11:23.667212+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]': finished 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[19831]: cluster 2024-09-21T05:11:23.675385+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[19831]: audit 2024-09-21T05:11:23.993551+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.89:0/3268718641' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[19831]: audit 2024-09-21T05:11:23.994510+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[26514]: audit 2024-09-21T05:11:23.667212+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]': finished 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[26514]: cluster 2024-09-21T05:11:23.675385+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[26514]: audit 2024-09-21T05:11:23.993551+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.89:0/3268718641' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:25.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:24 smithi089 bash[26514]: audit 2024-09-21T05:11:23.994510+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:25.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:24 smithi110 bash[22020]: audit 2024-09-21T05:11:23.667212+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? 172.21.15.89:0/131154100' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3923068703"}]': finished 2024-09-21T05:11:25.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:24 smithi110 bash[22020]: cluster 2024-09-21T05:11:23.675385+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-09-21T05:11:25.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:24 smithi110 bash[22020]: audit 2024-09-21T05:11:23.993551+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.89:0/3268718641' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:25.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:24 smithi110 bash[22020]: audit 2024-09-21T05:11:23.994510+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]: dispatch 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[19831]: cluster 2024-09-21T05:11:24.438082+0000 mgr.x (mgr.24436) 39 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[19831]: audit 2024-09-21T05:11:24.675966+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]': finished 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[19831]: cluster 2024-09-21T05:11:24.685187+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[26514]: cluster 2024-09-21T05:11:24.438082+0000 mgr.x (mgr.24436) 39 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[26514]: audit 2024-09-21T05:11:24.675966+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]': finished 2024-09-21T05:11:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:25 smithi089 bash[26514]: cluster 2024-09-21T05:11:24.685187+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-21T05:11:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:25 smithi110 bash[22020]: cluster 2024-09-21T05:11:24.438082+0000 mgr.x (mgr.24436) 39 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 992 B/s rd, 1 op/s 2024-09-21T05:11:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:25 smithi110 bash[22020]: audit 2024-09-21T05:11:24.675966+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/4065017620"}]': finished 2024-09-21T05:11:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:25 smithi110 bash[22020]: cluster 2024-09-21T05:11:24.685187+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-09-21T05:11:27.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[26514]: cluster 2024-09-21T05:11:26.438970+0000 mgr.x (mgr.24436) 40 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s 2024-09-21T05:11:27.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[26514]: audit 2024-09-21T05:11:27.489702+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:27.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[26514]: audit 2024-09-21T05:11:27.497964+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:27.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[19831]: cluster 2024-09-21T05:11:26.438970+0000 mgr.x (mgr.24436) 40 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s 2024-09-21T05:11:27.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[19831]: audit 2024-09-21T05:11:27.489702+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:27.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:27 smithi089 bash[19831]: audit 2024-09-21T05:11:27.497964+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:27 smithi110 bash[22020]: cluster 2024-09-21T05:11:26.438970+0000 mgr.x (mgr.24436) 40 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 802 B/s rd, 0 op/s 2024-09-21T05:11:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:27 smithi110 bash[22020]: audit 2024-09-21T05:11:27.489702+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:27 smithi110 bash[22020]: audit 2024-09-21T05:11:27.497964+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.528530+0000 mgr.x (mgr.24436) 41 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.747301+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.756799+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.758281+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.759967+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[26514]: audit 2024-09-21T05:11:27.768440+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.528530+0000 mgr.x (mgr.24436) 41 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.747301+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.756799+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.758281+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.759967+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:28 smithi089 bash[19831]: audit 2024-09-21T05:11:27.768440+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.528530+0000 mgr.x (mgr.24436) 41 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.747301+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.756799+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.758281+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.759967+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:11:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:28 smithi110 bash[22020]: audit 2024-09-21T05:11:27.768440+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:11:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:29 smithi089 bash[19831]: cluster 2024-09-21T05:11:28.440678+0000 mgr.x (mgr.24436) 42 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:29 smithi089 bash[26514]: cluster 2024-09-21T05:11:28.440678+0000 mgr.x (mgr.24436) 42 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:29 smithi110 bash[22020]: cluster 2024-09-21T05:11:28.440678+0000 mgr.x (mgr.24436) 42 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:31 smithi089 bash[19831]: cluster 2024-09-21T05:11:30.441506+0000 mgr.x (mgr.24436) 43 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 op/s 2024-09-21T05:11:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:31 smithi089 bash[26514]: cluster 2024-09-21T05:11:30.441506+0000 mgr.x (mgr.24436) 43 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 op/s 2024-09-21T05:11:32.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:31 smithi110 bash[22020]: cluster 2024-09-21T05:11:30.441506+0000 mgr.x (mgr.24436) 43 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 657 B/s rd, 0 op/s 2024-09-21T05:11:32.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:11:31] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:11:33.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:32 smithi089 bash[19831]: audit 2024-09-21T05:11:32.654421+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:33.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:32 smithi089 bash[26514]: audit 2024-09-21T05:11:32.654421+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:33.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:32 smithi110 bash[22020]: audit 2024-09-21T05:11:32.654421+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:33 smithi089 bash[19831]: cluster 2024-09-21T05:11:32.443185+0000 mgr.x (mgr.24436) 44 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:11:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:33 smithi089 bash[26514]: cluster 2024-09-21T05:11:32.443185+0000 mgr.x (mgr.24436) 44 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:11:34.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:33 smithi110 bash[22020]: cluster 2024-09-21T05:11:32.443185+0000 mgr.x (mgr.24436) 44 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:11:36.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:35 smithi089 bash[19831]: cluster 2024-09-21T05:11:34.443931+0000 mgr.x (mgr.24436) 45 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:11:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:35 smithi089 bash[26514]: cluster 2024-09-21T05:11:34.443931+0000 mgr.x (mgr.24436) 45 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:11:36.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:35 smithi110 bash[22020]: cluster 2024-09-21T05:11:34.443931+0000 mgr.x (mgr.24436) 45 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:11:38.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:37 smithi110 bash[22020]: cluster 2024-09-21T05:11:36.444871+0000 mgr.x (mgr.24436) 46 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 op/s 2024-09-21T05:11:38.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:37 smithi089 bash[19831]: cluster 2024-09-21T05:11:36.444871+0000 mgr.x (mgr.24436) 46 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 op/s 2024-09-21T05:11:38.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:37 smithi089 bash[26514]: cluster 2024-09-21T05:11:36.444871+0000 mgr.x (mgr.24436) 46 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 870 B/s rd, 0 op/s 2024-09-21T05:11:39.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:38 smithi089 bash[19831]: audit 2024-09-21T05:11:37.539842+0000 mgr.x (mgr.24436) 47 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:39.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:38 smithi089 bash[26514]: audit 2024-09-21T05:11:37.539842+0000 mgr.x (mgr.24436) 47 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:39.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:38 smithi110 bash[22020]: audit 2024-09-21T05:11:37.539842+0000 mgr.x (mgr.24436) 47 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:40.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:39 smithi089 bash[19831]: cluster 2024-09-21T05:11:38.446564+0000 mgr.x (mgr.24436) 48 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:40.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:39 smithi089 bash[26514]: cluster 2024-09-21T05:11:38.446564+0000 mgr.x (mgr.24436) 48 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:39 smithi110 bash[22020]: cluster 2024-09-21T05:11:38.446564+0000 mgr.x (mgr.24436) 48 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:42.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:41 smithi089 bash[26514]: cluster 2024-09-21T05:11:40.447277+0000 mgr.x (mgr.24436) 49 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:42.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:41 smithi089 bash[19831]: cluster 2024-09-21T05:11:40.447277+0000 mgr.x (mgr.24436) 49 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:42.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:41 smithi110 bash[22020]: cluster 2024-09-21T05:11:40.447277+0000 mgr.x (mgr.24436) 49 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:42.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:11:41] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:11:44.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:43 smithi089 bash[26514]: cluster 2024-09-21T05:11:42.449019+0000 mgr.x (mgr.24436) 50 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:44.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:43 smithi089 bash[19831]: cluster 2024-09-21T05:11:42.449019+0000 mgr.x (mgr.24436) 50 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:44.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:43 smithi110 bash[22020]: cluster 2024-09-21T05:11:42.449019+0000 mgr.x (mgr.24436) 50 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:46.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:45 smithi089 bash[19831]: cluster 2024-09-21T05:11:44.449786+0000 mgr.x (mgr.24436) 51 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:46.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:45 smithi089 bash[26514]: cluster 2024-09-21T05:11:44.449786+0000 mgr.x (mgr.24436) 51 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:46.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:45 smithi110 bash[22020]: cluster 2024-09-21T05:11:44.449786+0000 mgr.x (mgr.24436) 51 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:48.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:47 smithi089 bash[19831]: cluster 2024-09-21T05:11:46.450541+0000 mgr.x (mgr.24436) 52 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:48.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:47 smithi089 bash[19831]: audit 2024-09-21T05:11:47.654742+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:48.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:47 smithi089 bash[26514]: cluster 2024-09-21T05:11:46.450541+0000 mgr.x (mgr.24436) 52 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:48.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:47 smithi089 bash[26514]: audit 2024-09-21T05:11:47.654742+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:48.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:47 smithi110 bash[22020]: cluster 2024-09-21T05:11:46.450541+0000 mgr.x (mgr.24436) 52 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:48.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:47 smithi110 bash[22020]: audit 2024-09-21T05:11:47.654742+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:11:49.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:48 smithi089 bash[26514]: audit 2024-09-21T05:11:47.548424+0000 mgr.x (mgr.24436) 53 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:49.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:48 smithi089 bash[19831]: audit 2024-09-21T05:11:47.548424+0000 mgr.x (mgr.24436) 53 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:49.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:48 smithi110 bash[22020]: audit 2024-09-21T05:11:47.548424+0000 mgr.x (mgr.24436) 53 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:50.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:49 smithi089 bash[26514]: cluster 2024-09-21T05:11:48.452216+0000 mgr.x (mgr.24436) 54 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:50.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:49 smithi089 bash[19831]: cluster 2024-09-21T05:11:48.452216+0000 mgr.x (mgr.24436) 54 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:50.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:49 smithi110 bash[22020]: cluster 2024-09-21T05:11:48.452216+0000 mgr.x (mgr.24436) 54 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:52.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:51 smithi089 bash[26514]: cluster 2024-09-21T05:11:50.452955+0000 mgr.x (mgr.24436) 55 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:52.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:51 smithi089 bash[19831]: cluster 2024-09-21T05:11:50.452955+0000 mgr.x (mgr.24436) 55 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:52.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:11:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:11:51] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:11:52.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:51 smithi110 bash[22020]: cluster 2024-09-21T05:11:50.452955+0000 mgr.x (mgr.24436) 55 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:54.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:53 smithi089 bash[19831]: cluster 2024-09-21T05:11:52.454602+0000 mgr.x (mgr.24436) 56 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:54.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:53 smithi089 bash[26514]: cluster 2024-09-21T05:11:52.454602+0000 mgr.x (mgr.24436) 56 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:54.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:53 smithi110 bash[22020]: cluster 2024-09-21T05:11:52.454602+0000 mgr.x (mgr.24436) 56 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:11:56.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:55 smithi089 bash[19831]: cluster 2024-09-21T05:11:54.455331+0000 mgr.x (mgr.24436) 57 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:56.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:55 smithi089 bash[26514]: cluster 2024-09-21T05:11:54.455331+0000 mgr.x (mgr.24436) 57 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:56.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:55 smithi110 bash[22020]: cluster 2024-09-21T05:11:54.455331+0000 mgr.x (mgr.24436) 57 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:58.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:57 smithi089 bash[19831]: cluster 2024-09-21T05:11:56.456068+0000 mgr.x (mgr.24436) 58 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:58.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:57 smithi089 bash[26514]: cluster 2024-09-21T05:11:56.456068+0000 mgr.x (mgr.24436) 58 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:58.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:57 smithi110 bash[22020]: cluster 2024-09-21T05:11:56.456068+0000 mgr.x (mgr.24436) 58 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:11:59.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:58 smithi089 bash[19831]: audit 2024-09-21T05:11:57.559713+0000 mgr.x (mgr.24436) 59 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:59.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:58 smithi089 bash[26514]: audit 2024-09-21T05:11:57.559713+0000 mgr.x (mgr.24436) 59 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:11:59.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:58 smithi110 bash[22020]: audit 2024-09-21T05:11:57.559713+0000 mgr.x (mgr.24436) 59 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:00.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:11:59 smithi089 bash[19831]: cluster 2024-09-21T05:11:58.457719+0000 mgr.x (mgr.24436) 60 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:00.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:11:59 smithi089 bash[26514]: cluster 2024-09-21T05:11:58.457719+0000 mgr.x (mgr.24436) 60 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:00.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:11:59 smithi110 bash[22020]: cluster 2024-09-21T05:11:58.457719+0000 mgr.x (mgr.24436) 60 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:01.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:00 smithi089 bash[26514]: cluster 2024-09-21T05:12:00.458461+0000 mgr.x (mgr.24436) 61 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:01.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:00 smithi089 bash[19831]: cluster 2024-09-21T05:12:00.458461+0000 mgr.x (mgr.24436) 61 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:01.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:00 smithi110 bash[22020]: cluster 2024-09-21T05:12:00.458461+0000 mgr.x (mgr.24436) 61 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:02.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:01] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:12:03.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:03 smithi089 bash[26514]: cluster 2024-09-21T05:12:02.460237+0000 mgr.x (mgr.24436) 62 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:03.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:03 smithi089 bash[26514]: audit 2024-09-21T05:12:02.660774+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:03.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:03 smithi089 bash[19831]: cluster 2024-09-21T05:12:02.460237+0000 mgr.x (mgr.24436) 62 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:03.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:03 smithi089 bash[19831]: audit 2024-09-21T05:12:02.660774+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:03.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:03 smithi110 bash[22020]: cluster 2024-09-21T05:12:02.460237+0000 mgr.x (mgr.24436) 62 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:03.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:03 smithi110 bash[22020]: audit 2024-09-21T05:12:02.660774+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:05.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:05 smithi089 bash[19831]: cluster 2024-09-21T05:12:04.460952+0000 mgr.x (mgr.24436) 63 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:05.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:05 smithi089 bash[26514]: cluster 2024-09-21T05:12:04.460952+0000 mgr.x (mgr.24436) 63 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:05.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:05 smithi110 bash[22020]: cluster 2024-09-21T05:12:04.460952+0000 mgr.x (mgr.24436) 63 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:07.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:07 smithi089 bash[19831]: cluster 2024-09-21T05:12:06.461661+0000 mgr.x (mgr.24436) 64 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:07.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:07 smithi089 bash[26514]: cluster 2024-09-21T05:12:06.461661+0000 mgr.x (mgr.24436) 64 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:07.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:07 smithi110 bash[22020]: cluster 2024-09-21T05:12:06.461661+0000 mgr.x (mgr.24436) 64 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:08.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:08 smithi089 bash[19831]: audit 2024-09-21T05:12:07.571092+0000 mgr.x (mgr.24436) 65 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:08.793 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:08 smithi089 bash[26514]: audit 2024-09-21T05:12:07.571092+0000 mgr.x (mgr.24436) 65 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:08.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:08 smithi110 bash[22020]: audit 2024-09-21T05:12:07.571092+0000 mgr.x (mgr.24436) 65 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:09.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:09 smithi089 bash[19831]: cluster 2024-09-21T05:12:08.463885+0000 mgr.x (mgr.24436) 66 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:09.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:09 smithi089 bash[26514]: cluster 2024-09-21T05:12:08.463885+0000 mgr.x (mgr.24436) 66 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:09.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:09 smithi110 bash[22020]: cluster 2024-09-21T05:12:08.463885+0000 mgr.x (mgr.24436) 66 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:11.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:11 smithi110 bash[22020]: cluster 2024-09-21T05:12:10.464612+0000 mgr.x (mgr.24436) 67 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:11 smithi089 bash[19831]: cluster 2024-09-21T05:12:10.464612+0000 mgr.x (mgr.24436) 67 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:11 smithi089 bash[26514]: cluster 2024-09-21T05:12:10.464612+0000 mgr.x (mgr.24436) 67 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:12.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:11] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:12:13.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:13 smithi110 bash[22020]: cluster 2024-09-21T05:12:12.466240+0000 mgr.x (mgr.24436) 68 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:13 smithi089 bash[19831]: cluster 2024-09-21T05:12:12.466240+0000 mgr.x (mgr.24436) 68 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:13 smithi089 bash[26514]: cluster 2024-09-21T05:12:12.466240+0000 mgr.x (mgr.24436) 68 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:15 smithi089 bash[19831]: cluster 2024-09-21T05:12:14.466895+0000 mgr.x (mgr.24436) 69 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:15 smithi089 bash[26514]: cluster 2024-09-21T05:12:14.466895+0000 mgr.x (mgr.24436) 69 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:16.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:15 smithi110 bash[22020]: cluster 2024-09-21T05:12:14.466895+0000 mgr.x (mgr.24436) 69 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:17 smithi089 bash[19831]: cluster 2024-09-21T05:12:16.467629+0000 mgr.x (mgr.24436) 70 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:17 smithi089 bash[26514]: cluster 2024-09-21T05:12:16.467629+0000 mgr.x (mgr.24436) 70 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:17 smithi110 bash[22020]: cluster 2024-09-21T05:12:16.467629+0000 mgr.x (mgr.24436) 70 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:18 smithi089 bash[19831]: audit 2024-09-21T05:12:17.580483+0000 mgr.x (mgr.24436) 71 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:18 smithi089 bash[19831]: audit 2024-09-21T05:12:17.661040+0000 mon.a (mon.0) 1024 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:18 smithi089 bash[26514]: audit 2024-09-21T05:12:17.580483+0000 mgr.x (mgr.24436) 71 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:18 smithi089 bash[26514]: audit 2024-09-21T05:12:17.661040+0000 mon.a (mon.0) 1024 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:19.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:18 smithi110 bash[22020]: audit 2024-09-21T05:12:17.580483+0000 mgr.x (mgr.24436) 71 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:19.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:18 smithi110 bash[22020]: audit 2024-09-21T05:12:17.661040+0000 mon.a (mon.0) 1024 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:19 smithi089 bash[19831]: cluster 2024-09-21T05:12:18.469215+0000 mgr.x (mgr.24436) 72 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:19 smithi089 bash[26514]: cluster 2024-09-21T05:12:18.469215+0000 mgr.x (mgr.24436) 72 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:19 smithi110 bash[22020]: cluster 2024-09-21T05:12:18.469215+0000 mgr.x (mgr.24436) 72 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:21 smithi089 bash[19831]: cluster 2024-09-21T05:12:20.469902+0000 mgr.x (mgr.24436) 73 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:21 smithi089 bash[26514]: cluster 2024-09-21T05:12:20.469902+0000 mgr.x (mgr.24436) 73 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:22.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:21 smithi110 bash[22020]: cluster 2024-09-21T05:12:20.469902+0000 mgr.x (mgr.24436) 73 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:22.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:21] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.43.0" 2024-09-21T05:12:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:23 smithi089 bash[19831]: cluster 2024-09-21T05:12:22.471556+0000 mgr.x (mgr.24436) 74 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:23 smithi089 bash[26514]: cluster 2024-09-21T05:12:22.471556+0000 mgr.x (mgr.24436) 74 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:23 smithi110 bash[22020]: cluster 2024-09-21T05:12:22.471556+0000 mgr.x (mgr.24436) 74 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:25 smithi089 bash[19831]: cluster 2024-09-21T05:12:24.472267+0000 mgr.x (mgr.24436) 75 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:25 smithi089 bash[26514]: cluster 2024-09-21T05:12:24.472267+0000 mgr.x (mgr.24436) 75 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:25 smithi110 bash[22020]: cluster 2024-09-21T05:12:24.472267+0000 mgr.x (mgr.24436) 75 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:27 smithi089 bash[19831]: cluster 2024-09-21T05:12:26.472976+0000 mgr.x (mgr.24436) 76 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:27 smithi089 bash[26514]: cluster 2024-09-21T05:12:26.472976+0000 mgr.x (mgr.24436) 76 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:27 smithi110 bash[22020]: cluster 2024-09-21T05:12:26.472976+0000 mgr.x (mgr.24436) 76 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[19831]: audit 2024-09-21T05:12:27.588350+0000 mgr.x (mgr.24436) 77 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[19831]: audit 2024-09-21T05:12:28.444727+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[19831]: audit 2024-09-21T05:12:28.449702+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[26514]: audit 2024-09-21T05:12:27.588350+0000 mgr.x (mgr.24436) 77 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[26514]: audit 2024-09-21T05:12:28.444727+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:28 smithi089 bash[26514]: audit 2024-09-21T05:12:28.449702+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:28 smithi110 bash[22020]: audit 2024-09-21T05:12:27.588350+0000 mgr.x (mgr.24436) 77 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:28 smithi110 bash[22020]: audit 2024-09-21T05:12:28.444727+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:28 smithi110 bash[22020]: audit 2024-09-21T05:12:28.449702+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[19831]: cluster 2024-09-21T05:12:28.473826+0000 mgr.x (mgr.24436) 78 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[19831]: audit 2024-09-21T05:12:29.043685+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[19831]: audit 2024-09-21T05:12:29.045698+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[19831]: audit 2024-09-21T05:12:29.056331+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[26514]: cluster 2024-09-21T05:12:28.473826+0000 mgr.x (mgr.24436) 78 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[26514]: audit 2024-09-21T05:12:29.043685+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[26514]: audit 2024-09-21T05:12:29.045698+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:30.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:29 smithi089 bash[26514]: audit 2024-09-21T05:12:29.056331+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:29 smithi110 bash[22020]: cluster 2024-09-21T05:12:28.473826+0000 mgr.x (mgr.24436) 78 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:29 smithi110 bash[22020]: audit 2024-09-21T05:12:29.043685+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:12:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:29 smithi110 bash[22020]: audit 2024-09-21T05:12:29.045698+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:12:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:29 smithi110 bash[22020]: audit 2024-09-21T05:12:29.056331+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:12:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:31 smithi089 bash[19831]: cluster 2024-09-21T05:12:30.474491+0000 mgr.x (mgr.24436) 79 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:31 smithi089 bash[26514]: cluster 2024-09-21T05:12:30.474491+0000 mgr.x (mgr.24436) 79 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:32.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:31 smithi110 bash[22020]: cluster 2024-09-21T05:12:30.474491+0000 mgr.x (mgr.24436) 79 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:32.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:31] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.43.0" 2024-09-21T05:12:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:33 smithi089 bash[19831]: cluster 2024-09-21T05:12:32.476160+0000 mgr.x (mgr.24436) 80 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:33 smithi089 bash[19831]: audit 2024-09-21T05:12:32.661356+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:33 smithi089 bash[26514]: cluster 2024-09-21T05:12:32.476160+0000 mgr.x (mgr.24436) 80 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:33 smithi089 bash[26514]: audit 2024-09-21T05:12:32.661356+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:34.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:33 smithi110 bash[22020]: cluster 2024-09-21T05:12:32.476160+0000 mgr.x (mgr.24436) 80 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:34.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:33 smithi110 bash[22020]: audit 2024-09-21T05:12:32.661356+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:36.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:35 smithi089 bash[19831]: cluster 2024-09-21T05:12:34.476893+0000 mgr.x (mgr.24436) 81 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:35 smithi089 bash[26514]: cluster 2024-09-21T05:12:34.476893+0000 mgr.x (mgr.24436) 81 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:36.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:35 smithi110 bash[22020]: cluster 2024-09-21T05:12:34.476893+0000 mgr.x (mgr.24436) 81 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:38.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:37 smithi089 bash[19831]: cluster 2024-09-21T05:12:36.477602+0000 mgr.x (mgr.24436) 82 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:37 smithi089 bash[26514]: cluster 2024-09-21T05:12:36.477602+0000 mgr.x (mgr.24436) 82 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:38.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:37 smithi110 bash[22020]: cluster 2024-09-21T05:12:36.477602+0000 mgr.x (mgr.24436) 82 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:39.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:38 smithi089 bash[19831]: audit 2024-09-21T05:12:37.599679+0000 mgr.x (mgr.24436) 83 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:39.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:38 smithi089 bash[26514]: audit 2024-09-21T05:12:37.599679+0000 mgr.x (mgr.24436) 83 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:39.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:38 smithi110 bash[22020]: audit 2024-09-21T05:12:37.599679+0000 mgr.x (mgr.24436) 83 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:40.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:39 smithi089 bash[19831]: cluster 2024-09-21T05:12:38.479769+0000 mgr.x (mgr.24436) 84 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:39 smithi089 bash[26514]: cluster 2024-09-21T05:12:38.479769+0000 mgr.x (mgr.24436) 84 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:40.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:39 smithi110 bash[22020]: cluster 2024-09-21T05:12:38.479769+0000 mgr.x (mgr.24436) 84 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:42.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:41 smithi089 bash[19831]: cluster 2024-09-21T05:12:40.480507+0000 mgr.x (mgr.24436) 85 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:42.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:41 smithi089 bash[26514]: cluster 2024-09-21T05:12:40.480507+0000 mgr.x (mgr.24436) 85 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:42.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:41 smithi110 bash[22020]: cluster 2024-09-21T05:12:40.480507+0000 mgr.x (mgr.24436) 85 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:42.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:41] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:12:44.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:43 smithi089 bash[19831]: cluster 2024-09-21T05:12:42.482310+0000 mgr.x (mgr.24436) 86 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:44.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:43 smithi089 bash[26514]: cluster 2024-09-21T05:12:42.482310+0000 mgr.x (mgr.24436) 86 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:44.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:43 smithi110 bash[22020]: cluster 2024-09-21T05:12:42.482310+0000 mgr.x (mgr.24436) 86 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:12:46.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:45 smithi089 bash[19831]: cluster 2024-09-21T05:12:44.483047+0000 mgr.x (mgr.24436) 87 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:46.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:45 smithi089 bash[26514]: cluster 2024-09-21T05:12:44.483047+0000 mgr.x (mgr.24436) 87 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:46.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:45 smithi110 bash[22020]: cluster 2024-09-21T05:12:44.483047+0000 mgr.x (mgr.24436) 87 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:47 smithi089 bash[19831]: cluster 2024-09-21T05:12:46.483760+0000 mgr.x (mgr.24436) 88 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:47 smithi089 bash[26514]: cluster 2024-09-21T05:12:46.483760+0000 mgr.x (mgr.24436) 88 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:48.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:47 smithi110 bash[22020]: cluster 2024-09-21T05:12:46.483760+0000 mgr.x (mgr.24436) 88 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 263 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:12:49.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:48 smithi089 bash[19831]: audit 2024-09-21T05:12:47.608163+0000 mgr.x (mgr.24436) 89 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:49.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:48 smithi089 bash[19831]: audit 2024-09-21T05:12:47.662016+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:48 smithi089 bash[26514]: audit 2024-09-21T05:12:47.608163+0000 mgr.x (mgr.24436) 89 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:48 smithi089 bash[26514]: audit 2024-09-21T05:12:47.662016+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:49.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:48 smithi110 bash[22020]: audit 2024-09-21T05:12:47.608163+0000 mgr.x (mgr.24436) 89 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:49.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:48 smithi110 bash[22020]: audit 2024-09-21T05:12:47.662016+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:12:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:49 smithi089 bash[19831]: cluster 2024-09-21T05:12:48.485375+0000 mgr.x (mgr.24436) 90 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:50.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:49 smithi089 bash[26514]: cluster 2024-09-21T05:12:48.485375+0000 mgr.x (mgr.24436) 90 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:50.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:49 smithi110 bash[22020]: cluster 2024-09-21T05:12:48.485375+0000 mgr.x (mgr.24436) 90 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:52.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:51 smithi089 bash[19831]: cluster 2024-09-21T05:12:50.486163+0000 mgr.x (mgr.24436) 91 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:51 smithi089 bash[26514]: cluster 2024-09-21T05:12:50.486163+0000 mgr.x (mgr.24436) 91 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:52.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:51 smithi110 bash[22020]: cluster 2024-09-21T05:12:50.486163+0000 mgr.x (mgr.24436) 91 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:12:52.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:12:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:12:51] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:12:54.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:53 smithi089 bash[19831]: cluster 2024-09-21T05:12:52.487861+0000 mgr.x (mgr.24436) 92 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:12:54.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:53 smithi089 bash[26514]: cluster 2024-09-21T05:12:52.487861+0000 mgr.x (mgr.24436) 92 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:12:54.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:53 smithi110 bash[22020]: cluster 2024-09-21T05:12:52.487861+0000 mgr.x (mgr.24436) 92 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:12:56.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:55 smithi089 bash[19831]: cluster 2024-09-21T05:12:54.488527+0000 mgr.x (mgr.24436) 93 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:55 smithi089 bash[26514]: cluster 2024-09-21T05:12:54.488527+0000 mgr.x (mgr.24436) 93 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:56.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:55 smithi110 bash[22020]: cluster 2024-09-21T05:12:54.488527+0000 mgr.x (mgr.24436) 93 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:58.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:57 smithi089 bash[19831]: cluster 2024-09-21T05:12:56.489243+0000 mgr.x (mgr.24436) 94 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:58.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:57 smithi089 bash[26514]: cluster 2024-09-21T05:12:56.489243+0000 mgr.x (mgr.24436) 94 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:58.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:57 smithi110 bash[22020]: cluster 2024-09-21T05:12:56.489243+0000 mgr.x (mgr.24436) 94 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:12:59.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:58 smithi089 bash[19831]: audit 2024-09-21T05:12:57.619454+0000 mgr.x (mgr.24436) 95 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:59.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:58 smithi089 bash[26514]: audit 2024-09-21T05:12:57.619454+0000 mgr.x (mgr.24436) 95 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:12:59.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:58 smithi110 bash[22020]: audit 2024-09-21T05:12:57.619454+0000 mgr.x (mgr.24436) 95 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:12:59 smithi089 bash[19831]: cluster 2024-09-21T05:12:58.490883+0000 mgr.x (mgr.24436) 96 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:13:00.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:12:59 smithi089 bash[26514]: cluster 2024-09-21T05:12:58.490883+0000 mgr.x (mgr.24436) 96 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:13:00.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:12:59 smithi110 bash[22020]: cluster 2024-09-21T05:12:58.490883+0000 mgr.x (mgr.24436) 96 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:13:02.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:01 smithi089 bash[19831]: cluster 2024-09-21T05:13:00.491559+0000 mgr.x (mgr.24436) 97 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:02.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:01 smithi089 bash[26514]: cluster 2024-09-21T05:13:00.491559+0000 mgr.x (mgr.24436) 97 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:02.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:01 smithi110 bash[22020]: cluster 2024-09-21T05:13:00.491559+0000 mgr.x (mgr.24436) 97 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:02.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:01] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:13:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:02 smithi089 bash[19831]: audit 2024-09-21T05:13:02.662623+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:03.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:02 smithi089 bash[26514]: audit 2024-09-21T05:13:02.662623+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:03.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:02 smithi110 bash[22020]: audit 2024-09-21T05:13:02.662623+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:04.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:03 smithi089 bash[19831]: cluster 2024-09-21T05:13:02.493174+0000 mgr.x (mgr.24436) 98 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:04.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:03 smithi089 bash[26514]: cluster 2024-09-21T05:13:02.493174+0000 mgr.x (mgr.24436) 98 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:04.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:03 smithi110 bash[22020]: cluster 2024-09-21T05:13:02.493174+0000 mgr.x (mgr.24436) 98 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:13:06.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:05 smithi089 bash[19831]: cluster 2024-09-21T05:13:04.493868+0000 mgr.x (mgr.24436) 99 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:06.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:05 smithi089 bash[26514]: cluster 2024-09-21T05:13:04.493868+0000 mgr.x (mgr.24436) 99 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:06.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:05 smithi110 bash[22020]: cluster 2024-09-21T05:13:04.493868+0000 mgr.x (mgr.24436) 99 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:07 smithi089 bash[19831]: cluster 2024-09-21T05:13:06.494763+0000 mgr.x (mgr.24436) 100 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:07 smithi089 bash[26514]: cluster 2024-09-21T05:13:06.494763+0000 mgr.x (mgr.24436) 100 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:08.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:07 smithi110 bash[22020]: cluster 2024-09-21T05:13:06.494763+0000 mgr.x (mgr.24436) 100 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:09.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:08 smithi089 bash[19831]: audit 2024-09-21T05:13:07.630878+0000 mgr.x (mgr.24436) 101 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:09.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:08 smithi089 bash[26514]: audit 2024-09-21T05:13:07.630878+0000 mgr.x (mgr.24436) 101 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:09.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:08 smithi110 bash[22020]: audit 2024-09-21T05:13:07.630878+0000 mgr.x (mgr.24436) 101 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:09 smithi089 bash[19831]: cluster 2024-09-21T05:13:08.496290+0000 mgr.x (mgr.24436) 102 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:09 smithi089 bash[26514]: cluster 2024-09-21T05:13:08.496290+0000 mgr.x (mgr.24436) 102 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:09 smithi110 bash[22020]: cluster 2024-09-21T05:13:08.496290+0000 mgr.x (mgr.24436) 102 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:11 smithi089 bash[19831]: cluster 2024-09-21T05:13:10.497015+0000 mgr.x (mgr.24436) 103 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:11 smithi089 bash[26514]: cluster 2024-09-21T05:13:10.497015+0000 mgr.x (mgr.24436) 103 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:12.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:11 smithi110 bash[22020]: cluster 2024-09-21T05:13:10.497015+0000 mgr.x (mgr.24436) 103 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:12.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:11] "GET /metrics HTTP/1.1" 200 38229 "" "Prometheus/2.43.0" 2024-09-21T05:13:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:13 smithi089 bash[19831]: cluster 2024-09-21T05:13:12.498641+0000 mgr.x (mgr.24436) 104 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:13 smithi089 bash[26514]: cluster 2024-09-21T05:13:12.498641+0000 mgr.x (mgr.24436) 104 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:14.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:13 smithi110 bash[22020]: cluster 2024-09-21T05:13:12.498641+0000 mgr.x (mgr.24436) 104 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:15 smithi089 bash[19831]: cluster 2024-09-21T05:13:14.499353+0000 mgr.x (mgr.24436) 105 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:15 smithi089 bash[26514]: cluster 2024-09-21T05:13:14.499353+0000 mgr.x (mgr.24436) 105 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:16.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:15 smithi110 bash[22020]: cluster 2024-09-21T05:13:14.499353+0000 mgr.x (mgr.24436) 105 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:17 smithi089 bash[19831]: cluster 2024-09-21T05:13:16.500445+0000 mgr.x (mgr.24436) 106 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:17 smithi089 bash[19831]: audit 2024-09-21T05:13:17.663204+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:17 smithi089 bash[26514]: cluster 2024-09-21T05:13:16.500445+0000 mgr.x (mgr.24436) 106 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:17 smithi089 bash[26514]: audit 2024-09-21T05:13:17.663204+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:17 smithi110 bash[22020]: cluster 2024-09-21T05:13:16.500445+0000 mgr.x (mgr.24436) 106 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:17 smithi110 bash[22020]: audit 2024-09-21T05:13:17.663204+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:18 smithi089 bash[19831]: audit 2024-09-21T05:13:17.642261+0000 mgr.x (mgr.24436) 107 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:18 smithi089 bash[26514]: audit 2024-09-21T05:13:17.642261+0000 mgr.x (mgr.24436) 107 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:19.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:18 smithi110 bash[22020]: audit 2024-09-21T05:13:17.642261+0000 mgr.x (mgr.24436) 107 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:19 smithi089 bash[19831]: cluster 2024-09-21T05:13:18.501796+0000 mgr.x (mgr.24436) 108 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:19 smithi089 bash[26514]: cluster 2024-09-21T05:13:18.501796+0000 mgr.x (mgr.24436) 108 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:19 smithi110 bash[22020]: cluster 2024-09-21T05:13:18.501796+0000 mgr.x (mgr.24436) 108 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:21 smithi089 bash[19831]: cluster 2024-09-21T05:13:20.502523+0000 mgr.x (mgr.24436) 109 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:21 smithi089 bash[26514]: cluster 2024-09-21T05:13:20.502523+0000 mgr.x (mgr.24436) 109 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:22.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:21 smithi110 bash[22020]: cluster 2024-09-21T05:13:20.502523+0000 mgr.x (mgr.24436) 109 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:21] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.43.0" 2024-09-21T05:13:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:23 smithi089 bash[19831]: cluster 2024-09-21T05:13:22.504252+0000 mgr.x (mgr.24436) 110 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:23 smithi089 bash[26514]: cluster 2024-09-21T05:13:22.504252+0000 mgr.x (mgr.24436) 110 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:23 smithi110 bash[22020]: cluster 2024-09-21T05:13:22.504252+0000 mgr.x (mgr.24436) 110 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:26.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:25 smithi089 bash[19831]: cluster 2024-09-21T05:13:24.504932+0000 mgr.x (mgr.24436) 111 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:25 smithi089 bash[26514]: cluster 2024-09-21T05:13:24.504932+0000 mgr.x (mgr.24436) 111 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:26.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:25 smithi110 bash[22020]: cluster 2024-09-21T05:13:24.504932+0000 mgr.x (mgr.24436) 111 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:27 smithi089 bash[19831]: cluster 2024-09-21T05:13:26.506198+0000 mgr.x (mgr.24436) 112 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:28.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:27 smithi089 bash[26514]: cluster 2024-09-21T05:13:26.506198+0000 mgr.x (mgr.24436) 112 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:28.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:27 smithi110 bash[22020]: cluster 2024-09-21T05:13:26.506198+0000 mgr.x (mgr.24436) 112 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:28 smithi089 bash[19831]: audit 2024-09-21T05:13:27.651935+0000 mgr.x (mgr.24436) 113 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:28 smithi089 bash[26514]: audit 2024-09-21T05:13:27.651935+0000 mgr.x (mgr.24436) 113 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:29.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:28 smithi110 bash[22020]: audit 2024-09-21T05:13:27.651935+0000 mgr.x (mgr.24436) 113 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:29 smithi089 bash[19831]: cluster 2024-09-21T05:13:28.507491+0000 mgr.x (mgr.24436) 114 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:29 smithi089 bash[26514]: cluster 2024-09-21T05:13:28.507491+0000 mgr.x (mgr.24436) 114 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:29 smithi110 bash[22020]: cluster 2024-09-21T05:13:28.507491+0000 mgr.x (mgr.24436) 114 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[19831]: audit 2024-09-21T05:13:29.870709+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[19831]: audit 2024-09-21T05:13:29.872461+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[19831]: audit 2024-09-21T05:13:29.882613+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[26514]: audit 2024-09-21T05:13:29.870709+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[26514]: audit 2024-09-21T05:13:29.872461+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:31.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:30 smithi089 bash[26514]: audit 2024-09-21T05:13:29.882613+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:13:31.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:30 smithi110 bash[22020]: audit 2024-09-21T05:13:29.870709+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:13:31.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:30 smithi110 bash[22020]: audit 2024-09-21T05:13:29.872461+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:13:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:30 smithi110 bash[22020]: audit 2024-09-21T05:13:29.882613+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:13:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:31 smithi089 bash[19831]: cluster 2024-09-21T05:13:30.508189+0000 mgr.x (mgr.24436) 115 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:31 smithi089 bash[26514]: cluster 2024-09-21T05:13:30.508189+0000 mgr.x (mgr.24436) 115 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:32.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:31 smithi110 bash[22020]: cluster 2024-09-21T05:13:30.508189+0000 mgr.x (mgr.24436) 115 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:32.053 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:31] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.43.0" 2024-09-21T05:13:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:32 smithi110 bash[22020]: audit 2024-09-21T05:13:32.663488+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:33.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:32 smithi089 bash[19831]: audit 2024-09-21T05:13:32.663488+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:33.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:32 smithi089 bash[26514]: audit 2024-09-21T05:13:32.663488+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:33 smithi110 bash[22020]: cluster 2024-09-21T05:13:32.510278+0000 mgr.x (mgr.24436) 116 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:34.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:33 smithi089 bash[19831]: cluster 2024-09-21T05:13:32.510278+0000 mgr.x (mgr.24436) 116 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:34.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:33 smithi089 bash[26514]: cluster 2024-09-21T05:13:32.510278+0000 mgr.x (mgr.24436) 116 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:35 smithi110 bash[22020]: cluster 2024-09-21T05:13:34.511108+0000 mgr.x (mgr.24436) 117 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:36.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:35 smithi089 bash[19831]: cluster 2024-09-21T05:13:34.511108+0000 mgr.x (mgr.24436) 117 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:36.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:35 smithi089 bash[26514]: cluster 2024-09-21T05:13:34.511108+0000 mgr.x (mgr.24436) 117 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:38.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:37 smithi089 bash[19831]: cluster 2024-09-21T05:13:36.512791+0000 mgr.x (mgr.24436) 118 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:37 smithi089 bash[26514]: cluster 2024-09-21T05:13:36.512791+0000 mgr.x (mgr.24436) 118 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:38.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:37 smithi110 bash[22020]: cluster 2024-09-21T05:13:36.512791+0000 mgr.x (mgr.24436) 118 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:39.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:38 smithi089 bash[19831]: audit 2024-09-21T05:13:37.663299+0000 mgr.x (mgr.24436) 119 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:39.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:38 smithi089 bash[26514]: audit 2024-09-21T05:13:37.663299+0000 mgr.x (mgr.24436) 119 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:39.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:38 smithi110 bash[22020]: audit 2024-09-21T05:13:37.663299+0000 mgr.x (mgr.24436) 119 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:40.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:39 smithi089 bash[19831]: cluster 2024-09-21T05:13:38.513660+0000 mgr.x (mgr.24436) 120 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:40.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:39 smithi089 bash[26514]: cluster 2024-09-21T05:13:38.513660+0000 mgr.x (mgr.24436) 120 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:40.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:39 smithi110 bash[22020]: cluster 2024-09-21T05:13:38.513660+0000 mgr.x (mgr.24436) 120 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:42.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:41 smithi089 bash[19831]: cluster 2024-09-21T05:13:40.514486+0000 mgr.x (mgr.24436) 121 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:42.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:41 smithi089 bash[26514]: cluster 2024-09-21T05:13:40.514486+0000 mgr.x (mgr.24436) 121 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:42.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:41 smithi110 bash[22020]: cluster 2024-09-21T05:13:40.514486+0000 mgr.x (mgr.24436) 121 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:42.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:41] "GET /metrics HTTP/1.1" 200 38241 "" "Prometheus/2.43.0" 2024-09-21T05:13:44.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:43 smithi089 bash[19831]: cluster 2024-09-21T05:13:42.516175+0000 mgr.x (mgr.24436) 122 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:44.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:43 smithi089 bash[26514]: cluster 2024-09-21T05:13:42.516175+0000 mgr.x (mgr.24436) 122 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:44.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:43 smithi110 bash[22020]: cluster 2024-09-21T05:13:42.516175+0000 mgr.x (mgr.24436) 122 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:46.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:45 smithi089 bash[19831]: cluster 2024-09-21T05:13:44.516966+0000 mgr.x (mgr.24436) 123 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:46.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:45 smithi089 bash[26514]: cluster 2024-09-21T05:13:44.516966+0000 mgr.x (mgr.24436) 123 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:46.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:45 smithi110 bash[22020]: cluster 2024-09-21T05:13:44.516966+0000 mgr.x (mgr.24436) 123 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:47 smithi089 bash[19831]: cluster 2024-09-21T05:13:46.518523+0000 mgr.x (mgr.24436) 124 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:47 smithi089 bash[19831]: audit 2024-09-21T05:13:47.664050+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:47 smithi089 bash[26514]: cluster 2024-09-21T05:13:46.518523+0000 mgr.x (mgr.24436) 124 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:47 smithi089 bash[26514]: audit 2024-09-21T05:13:47.664050+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:47 smithi110 bash[22020]: cluster 2024-09-21T05:13:46.518523+0000 mgr.x (mgr.24436) 124 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:47 smithi110 bash[22020]: audit 2024-09-21T05:13:47.664050+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:13:49.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:48 smithi089 bash[19831]: audit 2024-09-21T05:13:47.671051+0000 mgr.x (mgr.24436) 125 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:49.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:48 smithi089 bash[26514]: audit 2024-09-21T05:13:47.671051+0000 mgr.x (mgr.24436) 125 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:49.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:48 smithi110 bash[22020]: audit 2024-09-21T05:13:47.671051+0000 mgr.x (mgr.24436) 125 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:50.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:49 smithi089 bash[19831]: cluster 2024-09-21T05:13:48.519197+0000 mgr.x (mgr.24436) 126 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:50.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:49 smithi089 bash[26514]: cluster 2024-09-21T05:13:48.519197+0000 mgr.x (mgr.24436) 126 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:50.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:49 smithi110 bash[22020]: cluster 2024-09-21T05:13:48.519197+0000 mgr.x (mgr.24436) 126 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:52.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:51 smithi089 bash[19831]: cluster 2024-09-21T05:13:50.519936+0000 mgr.x (mgr.24436) 127 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:52.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:51 smithi089 bash[26514]: cluster 2024-09-21T05:13:50.519936+0000 mgr.x (mgr.24436) 127 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:51 smithi110 bash[22020]: cluster 2024-09-21T05:13:50.519936+0000 mgr.x (mgr.24436) 127 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:52.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:13:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:13:51] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:13:54.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:53 smithi089 bash[26514]: cluster 2024-09-21T05:13:52.521575+0000 mgr.x (mgr.24436) 128 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:54.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:53 smithi089 bash[19831]: cluster 2024-09-21T05:13:52.521575+0000 mgr.x (mgr.24436) 128 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:54.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:53 smithi110 bash[22020]: cluster 2024-09-21T05:13:52.521575+0000 mgr.x (mgr.24436) 128 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:56.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:55 smithi089 bash[19831]: cluster 2024-09-21T05:13:54.522262+0000 mgr.x (mgr.24436) 129 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:56.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:55 smithi089 bash[26514]: cluster 2024-09-21T05:13:54.522262+0000 mgr.x (mgr.24436) 129 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:56.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:55 smithi110 bash[22020]: cluster 2024-09-21T05:13:54.522262+0000 mgr.x (mgr.24436) 129 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:13:58.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:57 smithi089 bash[19831]: cluster 2024-09-21T05:13:56.523942+0000 mgr.x (mgr.24436) 130 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:58.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:57 smithi089 bash[26514]: cluster 2024-09-21T05:13:56.523942+0000 mgr.x (mgr.24436) 130 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:57 smithi110 bash[22020]: cluster 2024-09-21T05:13:56.523942+0000 mgr.x (mgr.24436) 130 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:13:59.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:58 smithi089 bash[19831]: audit 2024-09-21T05:13:57.676852+0000 mgr.x (mgr.24436) 131 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:59.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:58 smithi089 bash[26514]: audit 2024-09-21T05:13:57.676852+0000 mgr.x (mgr.24436) 131 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:13:59.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:58 smithi110 bash[22020]: audit 2024-09-21T05:13:57.676852+0000 mgr.x (mgr.24436) 131 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:00.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:13:59 smithi089 bash[19831]: cluster 2024-09-21T05:13:58.524712+0000 mgr.x (mgr.24436) 132 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:00.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:13:59 smithi089 bash[26514]: cluster 2024-09-21T05:13:58.524712+0000 mgr.x (mgr.24436) 132 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:00.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:13:59 smithi110 bash[22020]: cluster 2024-09-21T05:13:58.524712+0000 mgr.x (mgr.24436) 132 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:02.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:01 smithi089 bash[19831]: cluster 2024-09-21T05:14:00.525525+0000 mgr.x (mgr.24436) 133 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:02.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:01 smithi089 bash[26514]: cluster 2024-09-21T05:14:00.525525+0000 mgr.x (mgr.24436) 133 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:02.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:01 smithi110 bash[22020]: cluster 2024-09-21T05:14:00.525525+0000 mgr.x (mgr.24436) 133 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:02.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:01] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:14:03.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:02 smithi089 bash[19831]: audit 2024-09-21T05:14:02.664586+0000 mon.a (mon.0) 1039 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:03.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:02 smithi089 bash[26514]: audit 2024-09-21T05:14:02.664586+0000 mon.a (mon.0) 1039 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:03.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:02 smithi110 bash[22020]: audit 2024-09-21T05:14:02.664586+0000 mon.a (mon.0) 1039 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:04.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:03 smithi089 bash[19831]: cluster 2024-09-21T05:14:02.527300+0000 mgr.x (mgr.24436) 134 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:04.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:03 smithi089 bash[26514]: cluster 2024-09-21T05:14:02.527300+0000 mgr.x (mgr.24436) 134 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:04.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:03 smithi110 bash[22020]: cluster 2024-09-21T05:14:02.527300+0000 mgr.x (mgr.24436) 134 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:05.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:04 smithi089 bash[19831]: cluster 2024-09-21T05:14:04.528083+0000 mgr.x (mgr.24436) 135 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:05.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:04 smithi089 bash[26514]: cluster 2024-09-21T05:14:04.528083+0000 mgr.x (mgr.24436) 135 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:05.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:04 smithi110 bash[22020]: cluster 2024-09-21T05:14:04.528083+0000 mgr.x (mgr.24436) 135 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:07.869 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:07 smithi089 bash[19831]: cluster 2024-09-21T05:14:06.529631+0000 mgr.x (mgr.24436) 136 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:07.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:07 smithi089 bash[26514]: cluster 2024-09-21T05:14:06.529631+0000 mgr.x (mgr.24436) 136 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:07.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T05:14:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:07 smithi110 bash[22020]: cluster 2024-09-21T05:14:06.529631+0000 mgr.x (mgr.24436) 136 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:09.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:08 smithi089 bash[19831]: audit 2024-09-21T05:14:07.687805+0000 mgr.x (mgr.24436) 137 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:09.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:08 smithi089 bash[26514]: audit 2024-09-21T05:14:07.687805+0000 mgr.x (mgr.24436) 137 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:09.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:08 smithi110 bash[22020]: audit 2024-09-21T05:14:07.687805+0000 mgr.x (mgr.24436) 137 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:09 smithi089 bash[19831]: cluster 2024-09-21T05:14:08.530407+0000 mgr.x (mgr.24436) 138 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:09 smithi089 bash[26514]: cluster 2024-09-21T05:14:08.530407+0000 mgr.x (mgr.24436) 138 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:10.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:09 smithi110 bash[22020]: cluster 2024-09-21T05:14:08.530407+0000 mgr.x (mgr.24436) 138 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:11 smithi089 bash[19831]: cluster 2024-09-21T05:14:10.531088+0000 mgr.x (mgr.24436) 139 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:11 smithi089 bash[26514]: cluster 2024-09-21T05:14:10.531088+0000 mgr.x (mgr.24436) 139 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:11 smithi110 bash[22020]: cluster 2024-09-21T05:14:10.531088+0000 mgr.x (mgr.24436) 139 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:12.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:11] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.43.0" 2024-09-21T05:14:12.686 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:14:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:13 smithi089 bash[19831]: cluster 2024-09-21T05:14:12.532729+0000 mgr.x (mgr.24436) 140 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:13 smithi089 bash[26514]: cluster 2024-09-21T05:14:12.532729+0000 mgr.x (mgr.24436) 140 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:13 smithi110 bash[22020]: cluster 2024-09-21T05:14:12.532729+0000 mgr.x (mgr.24436) 140 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:14.501 INFO:teuthology.orchestra.run.smithi089.stdout:Scheduled to redeploy mgr.y on host 'smithi089' 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.138910+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.89:0/896426839' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.470359+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.493918+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.503177+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.506064+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.507822+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.516484+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.557320+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.558792+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[19831]: audit 2024-09-21T05:14:14.560424+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.138910+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.89:0/896426839' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.470359+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.493918+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.503177+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.506064+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.507822+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.516484+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:14.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.557320+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:14:14.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.558792+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:14:14.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:14 smithi089 bash[26514]: audit 2024-09-21T05:14:14.560424+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.138910+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.89:0/896426839' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T05:14:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.470359+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.493918+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.503177+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.506064+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.507822+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.516484+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:14:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.557320+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:14:15.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.558792+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:14:15.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:14 smithi110 bash[22020]: audit 2024-09-21T05:14:14.560424+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:14:15.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps --refresh' 2024-09-21T05:14:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[19831]: audit 2024-09-21T05:14:14.455348+0000 mgr.x (mgr.24436) 141 : audit [DBG] from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[19831]: cephadm 2024-09-21T05:14:14.477504+0000 mgr.x (mgr.24436) 142 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-09-21T05:14:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[19831]: cluster 2024-09-21T05:14:14.533404+0000 mgr.x (mgr.24436) 143 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[19831]: cephadm 2024-09-21T05:14:14.559375+0000 mgr.x (mgr.24436) 144 : cephadm [INF] Deploying daemon mgr.y on smithi089 2024-09-21T05:14:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[26514]: audit 2024-09-21T05:14:14.455348+0000 mgr.x (mgr.24436) 141 : audit [DBG] from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[26514]: cephadm 2024-09-21T05:14:14.477504+0000 mgr.x (mgr.24436) 142 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-09-21T05:14:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[26514]: cluster 2024-09-21T05:14:14.533404+0000 mgr.x (mgr.24436) 143 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:15 smithi089 bash[26514]: cephadm 2024-09-21T05:14:14.559375+0000 mgr.x (mgr.24436) 144 : cephadm [INF] Deploying daemon mgr.y on smithi089 2024-09-21T05:14:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:15 smithi110 bash[22020]: audit 2024-09-21T05:14:14.455348+0000 mgr.x (mgr.24436) 141 : audit [DBG] from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:15 smithi110 bash[22020]: cephadm 2024-09-21T05:14:14.477504+0000 mgr.x (mgr.24436) 142 : cephadm [INF] Schedule redeploy daemon mgr.y 2024-09-21T05:14:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:15 smithi110 bash[22020]: cluster 2024-09-21T05:14:14.533404+0000 mgr.x (mgr.24436) 143 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:15 smithi110 bash[22020]: cephadm 2024-09-21T05:14:14.559375+0000 mgr.x (mgr.24436) 144 : cephadm [INF] Deploying daemon mgr.y on smithi089 2024-09-21T05:14:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:17 smithi089 bash[19831]: cluster 2024-09-21T05:14:16.535084+0000 mgr.x (mgr.24436) 145 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:17 smithi089 bash[26514]: cluster 2024-09-21T05:14:16.535084+0000 mgr.x (mgr.24436) 145 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:17 smithi110 bash[22020]: cluster 2024-09-21T05:14:16.535084+0000 mgr.x (mgr.24436) 145 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:18 smithi089 bash[19831]: audit 2024-09-21T05:14:17.665029+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:18 smithi089 bash[19831]: audit 2024-09-21T05:14:17.698824+0000 mgr.x (mgr.24436) 146 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:18 smithi089 bash[26514]: audit 2024-09-21T05:14:17.665029+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:18 smithi089 bash[26514]: audit 2024-09-21T05:14:17.698824+0000 mgr.x (mgr.24436) 146 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:18 smithi110 bash[22020]: audit 2024-09-21T05:14:17.665029+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:18 smithi110 bash[22020]: audit 2024-09-21T05:14:17.698824+0000 mgr.x (mgr.24436) 146 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:14:20.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:19 smithi089 bash[19831]: cluster 2024-09-21T05:14:18.535821+0000 mgr.x (mgr.24436) 147 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:19 smithi089 bash[26514]: cluster 2024-09-21T05:14:18.535821+0000 mgr.x (mgr.24436) 147 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:20.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:19 smithi110 bash[22020]: cluster 2024-09-21T05:14:18.535821+0000 mgr.x (mgr.24436) 147 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:21.891 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:21 smithi089 bash[19831]: cluster 2024-09-21T05:14:20.536524+0000 mgr.x (mgr.24436) 148 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:21.891 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:21 smithi089 bash[26514]: cluster 2024-09-21T05:14:20.536524+0000 mgr.x (mgr.24436) 148 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:21 smithi110 bash[22020]: cluster 2024-09-21T05:14:20.536524+0000 mgr.x (mgr.24436) 148 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:21] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (13m) 2m ago 13m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (13m) 2m ago 13m 75.3M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (3m) 2m ago 11m 74.0M - 3.8 164465d2334a 248332c6f564 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (6m) 2m ago 22m 496M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:9283,8765 running (24m) 2m ago 24m 426M - 19.1.1-373-g4e45e6b4 164465d2334a 326bedf203f9 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (24m) 2m ago 24m 61.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (22m) 2m ago 22m 47.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (22m) 2m ago 22m 48.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:14:22.301 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (14m) 2m ago 14m 8611k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (13m) 2m ago 14m 8599k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (21m) 2m ago 21m 53.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (20m) 2m ago 20m 62.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (19m) 2m ago 19m 58.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (18m) 2m ago 18m 52.7M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (17m) 2m ago 17m 65.8M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (16m) 2m ago 17m 51.6M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (16m) 2m ago 16m 58.8M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (15m) 2m ago 15m 59.8M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (3m) 2m ago 14m 32.8M - 2.43.0 a07b618ecd1d 1ccd3bbec32d 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (11m) 2m ago 11m 95.7M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:14:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (11m) 2m ago 11m 96.0M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:14:23.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:14:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:23 smithi089 bash[19831]: audit 2024-09-21T05:14:22.262454+0000 mgr.x (mgr.24436) 149 : audit [DBG] from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:24.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:23 smithi089 bash[19831]: cluster 2024-09-21T05:14:22.538124+0000 mgr.x (mgr.24436) 150 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:23 smithi089 bash[26514]: audit 2024-09-21T05:14:22.262454+0000 mgr.x (mgr.24436) 149 : audit [DBG] from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:24.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:23 smithi089 bash[26514]: cluster 2024-09-21T05:14:22.538124+0000 mgr.x (mgr.24436) 150 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:23 smithi110 bash[22020]: audit 2024-09-21T05:14:22.262454+0000 mgr.x (mgr.24436) 149 : audit [DBG] from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:14:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:23 smithi110 bash[22020]: cluster 2024-09-21T05:14:22.538124+0000 mgr.x (mgr.24436) 150 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:26.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:25 smithi089 bash[19831]: cluster 2024-09-21T05:14:24.538815+0000 mgr.x (mgr.24436) 151 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:26.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:25 smithi089 bash[26514]: cluster 2024-09-21T05:14:24.538815+0000 mgr.x (mgr.24436) 151 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:25 smithi110 bash[22020]: cluster 2024-09-21T05:14:24.538815+0000 mgr.x (mgr.24436) 151 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:28.036 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:14:28.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:27 smithi089 bash[19831]: cluster 2024-09-21T05:14:26.540352+0000 mgr.x (mgr.24436) 152 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:28.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:27 smithi089 bash[26514]: cluster 2024-09-21T05:14:26.540352+0000 mgr.x (mgr.24436) 152 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:27 smithi110 bash[22020]: cluster 2024-09-21T05:14:26.540352+0000 mgr.x (mgr.24436) 152 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:29.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:28 smithi089 bash[19831]: audit 2024-09-21T05:14:27.707506+0000 mgr.x (mgr.24436) 153 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:28 smithi089 bash[26514]: audit 2024-09-21T05:14:27.707506+0000 mgr.x (mgr.24436) 153 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:28 smithi110 bash[22020]: audit 2024-09-21T05:14:27.707506+0000 mgr.x (mgr.24436) 153 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:30.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:29 smithi089 bash[19831]: cluster 2024-09-21T05:14:28.541073+0000 mgr.x (mgr.24436) 154 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:29 smithi089 bash[26514]: cluster 2024-09-21T05:14:28.541073+0000 mgr.x (mgr.24436) 154 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:29 smithi110 bash[22020]: cluster 2024-09-21T05:14:28.541073+0000 mgr.x (mgr.24436) 154 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:31 smithi089 bash[26514]: cluster 2024-09-21T05:14:30.541723+0000 mgr.x (mgr.24436) 155 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:31 smithi089 bash[19831]: cluster 2024-09-21T05:14:30.541723+0000 mgr.x (mgr.24436) 155 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:31 smithi110 bash[22020]: cluster 2024-09-21T05:14:30.541723+0000 mgr.x (mgr.24436) 155 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:32.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:31] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:14:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:33 smithi089 bash[19831]: cluster 2024-09-21T05:14:32.543411+0000 mgr.x (mgr.24436) 156 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:34.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:33 smithi089 bash[19831]: audit 2024-09-21T05:14:32.670705+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:33 smithi089 bash[26514]: cluster 2024-09-21T05:14:32.543411+0000 mgr.x (mgr.24436) 156 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:34.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:33 smithi089 bash[26514]: audit 2024-09-21T05:14:32.670705+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:33 smithi110 bash[22020]: cluster 2024-09-21T05:14:32.543411+0000 mgr.x (mgr.24436) 156 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:33 smithi110 bash[22020]: audit 2024-09-21T05:14:32.670705+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:36.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:35 smithi089 bash[19831]: cluster 2024-09-21T05:14:34.544217+0000 mgr.x (mgr.24436) 157 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:35 smithi089 bash[26514]: cluster 2024-09-21T05:14:34.544217+0000 mgr.x (mgr.24436) 157 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:35 smithi110 bash[22020]: cluster 2024-09-21T05:14:34.544217+0000 mgr.x (mgr.24436) 157 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:38.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:37 smithi089 bash[19831]: cluster 2024-09-21T05:14:36.545827+0000 mgr.x (mgr.24436) 158 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:37 smithi089 bash[26514]: cluster 2024-09-21T05:14:36.545827+0000 mgr.x (mgr.24436) 158 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:37 smithi110 bash[22020]: cluster 2024-09-21T05:14:36.545827+0000 mgr.x (mgr.24436) 158 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:39.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:38 smithi089 bash[19831]: audit 2024-09-21T05:14:37.715446+0000 mgr.x (mgr.24436) 159 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:39.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:38 smithi089 bash[26514]: audit 2024-09-21T05:14:37.715446+0000 mgr.x (mgr.24436) 159 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:38 smithi110 bash[22020]: audit 2024-09-21T05:14:37.715446+0000 mgr.x (mgr.24436) 159 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:40.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:39 smithi089 bash[19831]: cluster 2024-09-21T05:14:38.546736+0000 mgr.x (mgr.24436) 160 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:39 smithi089 bash[26514]: cluster 2024-09-21T05:14:38.546736+0000 mgr.x (mgr.24436) 160 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:40.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:39 smithi110 bash[22020]: cluster 2024-09-21T05:14:38.546736+0000 mgr.x (mgr.24436) 160 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:42.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:41 smithi089 bash[19831]: cluster 2024-09-21T05:14:40.547431+0000 mgr.x (mgr.24436) 161 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:42.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:41 smithi089 bash[26514]: cluster 2024-09-21T05:14:40.547431+0000 mgr.x (mgr.24436) 161 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:42.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:41] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:14:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:41 smithi110 bash[22020]: cluster 2024-09-21T05:14:40.547431+0000 mgr.x (mgr.24436) 161 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:44.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:43 smithi089 bash[19831]: cluster 2024-09-21T05:14:42.549092+0000 mgr.x (mgr.24436) 162 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:44.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:43 smithi089 bash[26514]: cluster 2024-09-21T05:14:42.549092+0000 mgr.x (mgr.24436) 162 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:43 smithi110 bash[22020]: cluster 2024-09-21T05:14:42.549092+0000 mgr.x (mgr.24436) 162 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:46.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:45 smithi089 bash[26514]: cluster 2024-09-21T05:14:44.549821+0000 mgr.x (mgr.24436) 163 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:46.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:45 smithi089 bash[19831]: cluster 2024-09-21T05:14:44.549821+0000 mgr.x (mgr.24436) 163 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:45 smithi110 bash[22020]: cluster 2024-09-21T05:14:44.549821+0000 mgr.x (mgr.24436) 163 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:48.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:47 smithi089 bash[19831]: cluster 2024-09-21T05:14:46.551402+0000 mgr.x (mgr.24436) 164 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:48.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:47 smithi089 bash[19831]: audit 2024-09-21T05:14:47.665970+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:47 smithi089 bash[26514]: cluster 2024-09-21T05:14:46.551402+0000 mgr.x (mgr.24436) 164 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:48.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:47 smithi089 bash[26514]: audit 2024-09-21T05:14:47.665970+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:47 smithi110 bash[22020]: cluster 2024-09-21T05:14:46.551402+0000 mgr.x (mgr.24436) 164 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:47 smithi110 bash[22020]: audit 2024-09-21T05:14:47.665970+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:14:49.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:48 smithi089 bash[19831]: audit 2024-09-21T05:14:47.726453+0000 mgr.x (mgr.24436) 165 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:48 smithi089 bash[26514]: audit 2024-09-21T05:14:47.726453+0000 mgr.x (mgr.24436) 165 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:48 smithi110 bash[22020]: audit 2024-09-21T05:14:47.726453+0000 mgr.x (mgr.24436) 165 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:49 smithi089 bash[19831]: cluster 2024-09-21T05:14:48.552086+0000 mgr.x (mgr.24436) 166 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:50.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:49 smithi089 bash[26514]: cluster 2024-09-21T05:14:48.552086+0000 mgr.x (mgr.24436) 166 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:49 smithi110 bash[22020]: cluster 2024-09-21T05:14:48.552086+0000 mgr.x (mgr.24436) 166 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:52.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:51 smithi089 bash[26514]: cluster 2024-09-21T05:14:50.552820+0000 mgr.x (mgr.24436) 167 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:52.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:51 smithi089 bash[19831]: cluster 2024-09-21T05:14:50.552820+0000 mgr.x (mgr.24436) 167 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:51 smithi110 bash[22020]: cluster 2024-09-21T05:14:50.552820+0000 mgr.x (mgr.24436) 167 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:52.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:14:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:14:51] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:14:54.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:53 smithi089 bash[19831]: cluster 2024-09-21T05:14:52.554496+0000 mgr.x (mgr.24436) 168 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:54.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:53 smithi089 bash[26514]: cluster 2024-09-21T05:14:52.554496+0000 mgr.x (mgr.24436) 168 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:53 smithi110 bash[22020]: cluster 2024-09-21T05:14:52.554496+0000 mgr.x (mgr.24436) 168 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:56.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:55 smithi089 bash[19831]: cluster 2024-09-21T05:14:54.555242+0000 mgr.x (mgr.24436) 169 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:56.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:55 smithi089 bash[26514]: cluster 2024-09-21T05:14:54.555242+0000 mgr.x (mgr.24436) 169 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:55 smithi110 bash[22020]: cluster 2024-09-21T05:14:54.555242+0000 mgr.x (mgr.24436) 169 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:14:58.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:57 smithi089 bash[19831]: cluster 2024-09-21T05:14:56.556828+0000 mgr.x (mgr.24436) 170 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:58.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:57 smithi089 bash[26514]: cluster 2024-09-21T05:14:56.556828+0000 mgr.x (mgr.24436) 170 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:57 smithi110 bash[22020]: cluster 2024-09-21T05:14:56.556828+0000 mgr.x (mgr.24436) 170 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:14:59.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:58 smithi089 bash[19831]: audit 2024-09-21T05:14:57.735243+0000 mgr.x (mgr.24436) 171 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:59.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:58 smithi089 bash[26514]: audit 2024-09-21T05:14:57.735243+0000 mgr.x (mgr.24436) 171 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:14:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:58 smithi110 bash[22020]: audit 2024-09-21T05:14:57.735243+0000 mgr.x (mgr.24436) 171 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:00.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:14:59 smithi089 bash[26514]: cluster 2024-09-21T05:14:58.557542+0000 mgr.x (mgr.24436) 172 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:14:59 smithi089 bash[19831]: cluster 2024-09-21T05:14:58.557542+0000 mgr.x (mgr.24436) 172 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:14:59 smithi110 bash[22020]: cluster 2024-09-21T05:14:58.557542+0000 mgr.x (mgr.24436) 172 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:02.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:01 smithi089 bash[26514]: cluster 2024-09-21T05:15:00.558388+0000 mgr.x (mgr.24436) 173 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:02.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:01 smithi089 bash[19831]: cluster 2024-09-21T05:15:00.558388+0000 mgr.x (mgr.24436) 173 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:01 smithi110 bash[22020]: cluster 2024-09-21T05:15:00.558388+0000 mgr.x (mgr.24436) 173 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:02.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:01] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:15:03.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:02 smithi089 bash[26514]: audit 2024-09-21T05:15:02.666622+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:03.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:02 smithi089 bash[19831]: audit 2024-09-21T05:15:02.666622+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:02 smithi110 bash[22020]: audit 2024-09-21T05:15:02.666622+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:04.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:03 smithi089 bash[19831]: cluster 2024-09-21T05:15:02.560206+0000 mgr.x (mgr.24436) 174 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:04.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:03 smithi089 bash[26514]: cluster 2024-09-21T05:15:02.560206+0000 mgr.x (mgr.24436) 174 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:03 smithi110 bash[22020]: cluster 2024-09-21T05:15:02.560206+0000 mgr.x (mgr.24436) 174 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:06.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:05 smithi089 bash[19831]: cluster 2024-09-21T05:15:04.560973+0000 mgr.x (mgr.24436) 175 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:06.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:05 smithi089 bash[26514]: cluster 2024-09-21T05:15:04.560973+0000 mgr.x (mgr.24436) 175 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:05 smithi110 bash[22020]: cluster 2024-09-21T05:15:04.560973+0000 mgr.x (mgr.24436) 175 : cluster [DBG] pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:08.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:07 smithi089 bash[19831]: cluster 2024-09-21T05:15:06.562561+0000 mgr.x (mgr.24436) 176 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:07 smithi089 bash[26514]: cluster 2024-09-21T05:15:06.562561+0000 mgr.x (mgr.24436) 176 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:07 smithi110 bash[22020]: cluster 2024-09-21T05:15:06.562561+0000 mgr.x (mgr.24436) 176 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:09.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:08 smithi089 bash[19831]: audit 2024-09-21T05:15:07.746451+0000 mgr.x (mgr.24436) 177 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:09.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:08 smithi089 bash[26514]: audit 2024-09-21T05:15:07.746451+0000 mgr.x (mgr.24436) 177 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:08 smithi110 bash[22020]: audit 2024-09-21T05:15:07.746451+0000 mgr.x (mgr.24436) 177 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:10.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:09 smithi089 bash[26514]: cluster 2024-09-21T05:15:08.563368+0000 mgr.x (mgr.24436) 178 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:09 smithi089 bash[19831]: cluster 2024-09-21T05:15:08.563368+0000 mgr.x (mgr.24436) 178 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:09 smithi110 bash[22020]: cluster 2024-09-21T05:15:08.563368+0000 mgr.x (mgr.24436) 178 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:10.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.315 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.315 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.316 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.316 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.316 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.316 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: Stopping Ceph mgr.y for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:15:10.316 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.317 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:10.317 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.130 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:10 smithi089 bash[67903]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-y 2024-09-21T05:15:11.130 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:10 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:15:11.130 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[67963]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-y 2024-09-21T05:15:11.130 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T05:15:11.130 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: Stopped Ceph mgr.y for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:15:11.542 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.543 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.543 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.543 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.544 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.544 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: Started Ceph mgr.y for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:15:11.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.544 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:11.544 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:15:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[19831]: cluster 2024-09-21T05:15:10.564232+0000 mgr.x (mgr.24436) 179 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[19831]: audit 2024-09-21T05:15:11.308086+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[19831]: audit 2024-09-21T05:15:11.313883+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[19831]: audit 2024-09-21T05:15:11.319851+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[19831]: audit 2024-09-21T05:15:11.325324+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[26514]: cluster 2024-09-21T05:15:10.564232+0000 mgr.x (mgr.24436) 179 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[26514]: audit 2024-09-21T05:15:11.308086+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[26514]: audit 2024-09-21T05:15:11.313883+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[26514]: audit 2024-09-21T05:15:11.319851+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:11 smithi089 bash[26514]: audit 2024-09-21T05:15:11.325324+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:11] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[22020]: cluster 2024-09-21T05:15:10.564232+0000 mgr.x (mgr.24436) 179 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[22020]: audit 2024-09-21T05:15:11.308086+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[22020]: audit 2024-09-21T05:15:11.313883+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[22020]: audit 2024-09-21T05:15:11.319851+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:11 smithi110 bash[22020]: audit 2024-09-21T05:15:11.325324+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:12.792 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:12 smithi089 bash[68019]: debug 2024-09-21T05:15:12.508+0000 7ffa501a5640 1 -- 172.21.15.89:0/2627115780 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b891d510e0 con 0x55b891d53400 2024-09-21T05:15:14.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:13 smithi089 bash[19831]: cluster 2024-09-21T05:15:12.565948+0000 mgr.x (mgr.24436) 180 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:13 smithi089 bash[26514]: cluster 2024-09-21T05:15:12.565948+0000 mgr.x (mgr.24436) 180 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:13 smithi110 bash[22020]: cluster 2024-09-21T05:15:12.565948+0000 mgr.x (mgr.24436) 180 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:16.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:15 smithi089 bash[19831]: cluster 2024-09-21T05:15:14.566666+0000 mgr.x (mgr.24436) 181 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:15 smithi089 bash[26514]: cluster 2024-09-21T05:15:14.566666+0000 mgr.x (mgr.24436) 181 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:15 smithi110 bash[22020]: cluster 2024-09-21T05:15:14.566666+0000 mgr.x (mgr.24436) 181 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: cluster 2024-09-21T05:15:16.567527+0000 mgr.x (mgr.24436) 182 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: audit 2024-09-21T05:15:17.280509+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: audit 2024-09-21T05:15:17.285045+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: audit 2024-09-21T05:15:17.470438+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: audit 2024-09-21T05:15:17.481652+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[19831]: audit 2024-09-21T05:15:17.666968+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: cluster 2024-09-21T05:15:16.567527+0000 mgr.x (mgr.24436) 182 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: audit 2024-09-21T05:15:17.280509+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: audit 2024-09-21T05:15:17.285045+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: audit 2024-09-21T05:15:17.470438+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: audit 2024-09-21T05:15:17.481652+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:17 smithi089 bash[26514]: audit 2024-09-21T05:15:17.666968+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:18.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: cluster 2024-09-21T05:15:16.567527+0000 mgr.x (mgr.24436) 182 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: audit 2024-09-21T05:15:17.280509+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: audit 2024-09-21T05:15:17.285045+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: audit 2024-09-21T05:15:17.470438+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: audit 2024-09-21T05:15:17.481652+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:17 smithi110 bash[22020]: audit 2024-09-21T05:15:17.666968+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[68019]: [21/Sep/2024:05:15:18] ENGINE Bus STARTING 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[68019]: CherryPy Checker: 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[68019]: The Application mounted at '' has an empty config. 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[68019]: [21/Sep/2024:05:15:18] ENGINE Serving on http://:::9283 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[68019]: [21/Sep/2024:05:15:18] ENGINE Bus STARTED 2024-09-21T05:15:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:17.757678+0000 mgr.x (mgr.24436) 183 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.111514+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.113145+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.123671+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: cluster 2024-09-21T05:15:18.639880+0000 mon.a (mon.0) 1066 : cluster [DBG] Standby manager daemon y restarted 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: cluster 2024-09-21T05:15:18.640059+0000 mon.a (mon.0) 1067 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.641139+0000 mon.c (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.642226+0000 mon.c (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.643970+0000 mon.c (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[26514]: audit 2024-09-21T05:15:18.645315+0000 mon.c (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:17.757678+0000 mgr.x (mgr.24436) 183 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:19.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.111514+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.113145+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.123671+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: cluster 2024-09-21T05:15:18.639880+0000 mon.a (mon.0) 1066 : cluster [DBG] Standby manager daemon y restarted 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: cluster 2024-09-21T05:15:18.640059+0000 mon.a (mon.0) 1067 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.641139+0000 mon.c (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.642226+0000 mon.c (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.643970+0000 mon.c (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:15:19.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:18 smithi089 bash[19831]: audit 2024-09-21T05:15:18.645315+0000 mon.c (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:17.757678+0000 mgr.x (mgr.24436) 183 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.111514+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.113145+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.123671+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: cluster 2024-09-21T05:15:18.639880+0000 mon.a (mon.0) 1066 : cluster [DBG] Standby manager daemon y restarted 2024-09-21T05:15:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: cluster 2024-09-21T05:15:18.640059+0000 mon.a (mon.0) 1067 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:15:19.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.641139+0000 mon.c (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:15:19.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.642226+0000 mon.c (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:15:19.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.643970+0000 mon.c (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:15:19.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:18 smithi110 bash[22020]: audit 2024-09-21T05:15:18.645315+0000 mon.c (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:15:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:19 smithi089 bash[19831]: cluster 2024-09-21T05:15:18.568197+0000 mgr.x (mgr.24436) 184 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:19 smithi089 bash[19831]: cluster 2024-09-21T05:15:19.144273+0000 mon.a (mon.0) 1068 : cluster [DBG] mgrmap e28: x(active, since 4m), standbys: y 2024-09-21T05:15:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:19 smithi089 bash[26514]: cluster 2024-09-21T05:15:18.568197+0000 mgr.x (mgr.24436) 184 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:19 smithi089 bash[26514]: cluster 2024-09-21T05:15:19.144273+0000 mon.a (mon.0) 1068 : cluster [DBG] mgrmap e28: x(active, since 4m), standbys: y 2024-09-21T05:15:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:19 smithi110 bash[22020]: cluster 2024-09-21T05:15:18.568197+0000 mgr.x (mgr.24436) 184 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:19 smithi110 bash[22020]: cluster 2024-09-21T05:15:19.144273+0000 mon.a (mon.0) 1068 : cluster [DBG] mgrmap e28: x(active, since 4m), standbys: y 2024-09-21T05:15:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:21] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:15:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:21 smithi110 bash[22020]: cluster 2024-09-21T05:15:20.569021+0000 mgr.x (mgr.24436) 185 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:22.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:21 smithi089 bash[19831]: cluster 2024-09-21T05:15:20.569021+0000 mgr.x (mgr.24436) 185 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:22.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:21 smithi089 bash[26514]: cluster 2024-09-21T05:15:20.569021+0000 mgr.x (mgr.24436) 185 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:23 smithi110 bash[22020]: cluster 2024-09-21T05:15:22.570824+0000 mgr.x (mgr.24436) 186 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:24.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:23 smithi089 bash[19831]: cluster 2024-09-21T05:15:22.570824+0000 mgr.x (mgr.24436) 186 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:24.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:23 smithi089 bash[26514]: cluster 2024-09-21T05:15:22.570824+0000 mgr.x (mgr.24436) 186 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:26.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:25 smithi089 bash[19831]: cluster 2024-09-21T05:15:24.571717+0000 mgr.x (mgr.24436) 187 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:26.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:25 smithi089 bash[26514]: cluster 2024-09-21T05:15:24.571717+0000 mgr.x (mgr.24436) 187 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:25 smithi110 bash[22020]: cluster 2024-09-21T05:15:24.571717+0000 mgr.x (mgr.24436) 187 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:28.042 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:27 smithi089 bash[26514]: cluster 2024-09-21T05:15:26.573416+0000 mgr.x (mgr.24436) 188 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:27 smithi089 bash[19831]: cluster 2024-09-21T05:15:26.573416+0000 mgr.x (mgr.24436) 188 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:27 smithi110 bash[22020]: cluster 2024-09-21T05:15:26.573416+0000 mgr.x (mgr.24436) 188 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:29.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:28 smithi089 bash[19831]: audit 2024-09-21T05:15:27.763743+0000 mgr.x (mgr.24436) 189 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:29.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:28 smithi089 bash[26514]: audit 2024-09-21T05:15:27.763743+0000 mgr.x (mgr.24436) 189 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:28 smithi110 bash[22020]: audit 2024-09-21T05:15:27.763743+0000 mgr.x (mgr.24436) 189 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:30.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:29 smithi089 bash[19831]: cluster 2024-09-21T05:15:28.574285+0000 mgr.x (mgr.24436) 190 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:30.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:29 smithi089 bash[26514]: cluster 2024-09-21T05:15:28.574285+0000 mgr.x (mgr.24436) 190 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:29 smithi110 bash[22020]: cluster 2024-09-21T05:15:28.574285+0000 mgr.x (mgr.24436) 190 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:32.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:31 smithi089 bash[19831]: cluster 2024-09-21T05:15:30.575135+0000 mgr.x (mgr.24436) 191 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:32.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:31 smithi089 bash[26514]: cluster 2024-09-21T05:15:30.575135+0000 mgr.x (mgr.24436) 191 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:31 smithi110 bash[22020]: cluster 2024-09-21T05:15:30.575135+0000 mgr.x (mgr.24436) 191 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:32.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:31] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:15:33.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:32 smithi089 bash[19831]: audit 2024-09-21T05:15:32.667772+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:33.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:32 smithi089 bash[26514]: audit 2024-09-21T05:15:32.667772+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:32 smithi110 bash[22020]: audit 2024-09-21T05:15:32.667772+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:34.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:33 smithi089 bash[19831]: cluster 2024-09-21T05:15:32.576949+0000 mgr.x (mgr.24436) 192 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:34.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:33 smithi089 bash[26514]: cluster 2024-09-21T05:15:32.576949+0000 mgr.x (mgr.24436) 192 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:33 smithi110 bash[22020]: cluster 2024-09-21T05:15:32.576949+0000 mgr.x (mgr.24436) 192 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:36.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:35 smithi089 bash[19831]: cluster 2024-09-21T05:15:34.577813+0000 mgr.x (mgr.24436) 193 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:36.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:35 smithi089 bash[26514]: cluster 2024-09-21T05:15:34.577813+0000 mgr.x (mgr.24436) 193 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:36.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:35 smithi110 bash[22020]: cluster 2024-09-21T05:15:34.577813+0000 mgr.x (mgr.24436) 193 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:38.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:37 smithi089 bash[19831]: cluster 2024-09-21T05:15:36.579515+0000 mgr.x (mgr.24436) 194 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:37 smithi089 bash[26514]: cluster 2024-09-21T05:15:36.579515+0000 mgr.x (mgr.24436) 194 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:38.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:37 smithi110 bash[22020]: cluster 2024-09-21T05:15:36.579515+0000 mgr.x (mgr.24436) 194 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:39.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:38 smithi089 bash[19831]: audit 2024-09-21T05:15:37.775105+0000 mgr.x (mgr.24436) 195 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:39.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:38 smithi089 bash[26514]: audit 2024-09-21T05:15:37.775105+0000 mgr.x (mgr.24436) 195 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:39.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:38 smithi110 bash[22020]: audit 2024-09-21T05:15:37.775105+0000 mgr.x (mgr.24436) 195 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:40.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:39 smithi089 bash[19831]: cluster 2024-09-21T05:15:38.580399+0000 mgr.x (mgr.24436) 196 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:40.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:39 smithi089 bash[26514]: cluster 2024-09-21T05:15:38.580399+0000 mgr.x (mgr.24436) 196 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:40.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:39 smithi110 bash[22020]: cluster 2024-09-21T05:15:38.580399+0000 mgr.x (mgr.24436) 196 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:42.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:41 smithi089 bash[19831]: cluster 2024-09-21T05:15:40.581246+0000 mgr.x (mgr.24436) 197 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:42.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:41 smithi089 bash[26514]: cluster 2024-09-21T05:15:40.581246+0000 mgr.x (mgr.24436) 197 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:42.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:41 smithi110 bash[22020]: cluster 2024-09-21T05:15:40.581246+0000 mgr.x (mgr.24436) 197 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:42.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:41] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.43.0" 2024-09-21T05:15:44.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:43 smithi089 bash[19831]: cluster 2024-09-21T05:15:42.583015+0000 mgr.x (mgr.24436) 198 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:44.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:43 smithi089 bash[26514]: cluster 2024-09-21T05:15:42.583015+0000 mgr.x (mgr.24436) 198 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:43 smithi110 bash[22020]: cluster 2024-09-21T05:15:42.583015+0000 mgr.x (mgr.24436) 198 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:46.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:45 smithi089 bash[19831]: cluster 2024-09-21T05:15:44.583910+0000 mgr.x (mgr.24436) 199 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:46.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:45 smithi089 bash[26514]: cluster 2024-09-21T05:15:44.583910+0000 mgr.x (mgr.24436) 199 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:45 smithi110 bash[22020]: cluster 2024-09-21T05:15:44.583910+0000 mgr.x (mgr.24436) 199 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:47 smithi089 bash[19831]: cluster 2024-09-21T05:15:46.585519+0000 mgr.x (mgr.24436) 200 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:47 smithi089 bash[19831]: audit 2024-09-21T05:15:47.668127+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:48.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:47 smithi089 bash[26514]: cluster 2024-09-21T05:15:46.585519+0000 mgr.x (mgr.24436) 200 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:48.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:47 smithi089 bash[26514]: audit 2024-09-21T05:15:47.668127+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:47 smithi110 bash[22020]: cluster 2024-09-21T05:15:46.585519+0000 mgr.x (mgr.24436) 200 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:47 smithi110 bash[22020]: audit 2024-09-21T05:15:47.668127+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:15:49.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:48 smithi089 bash[19831]: audit 2024-09-21T05:15:47.777937+0000 mgr.x (mgr.24436) 201 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:49.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:48 smithi089 bash[26514]: audit 2024-09-21T05:15:47.777937+0000 mgr.x (mgr.24436) 201 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:48 smithi110 bash[22020]: audit 2024-09-21T05:15:47.777937+0000 mgr.x (mgr.24436) 201 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:50.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:49 smithi089 bash[19831]: cluster 2024-09-21T05:15:48.586357+0000 mgr.x (mgr.24436) 202 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:50.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:49 smithi089 bash[26514]: cluster 2024-09-21T05:15:48.586357+0000 mgr.x (mgr.24436) 202 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:49 smithi110 bash[22020]: cluster 2024-09-21T05:15:48.586357+0000 mgr.x (mgr.24436) 202 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:52.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:51 smithi089 bash[19831]: cluster 2024-09-21T05:15:50.587221+0000 mgr.x (mgr.24436) 203 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:52.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:51 smithi089 bash[26514]: cluster 2024-09-21T05:15:50.587221+0000 mgr.x (mgr.24436) 203 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:51 smithi110 bash[22020]: cluster 2024-09-21T05:15:50.587221+0000 mgr.x (mgr.24436) 203 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:52.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:15:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:15:51] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.43.0" 2024-09-21T05:15:54.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:53 smithi089 bash[19831]: cluster 2024-09-21T05:15:52.589034+0000 mgr.x (mgr.24436) 204 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:54.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:53 smithi089 bash[26514]: cluster 2024-09-21T05:15:52.589034+0000 mgr.x (mgr.24436) 204 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:53 smithi110 bash[22020]: cluster 2024-09-21T05:15:52.589034+0000 mgr.x (mgr.24436) 204 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:56.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:55 smithi089 bash[19831]: cluster 2024-09-21T05:15:54.589892+0000 mgr.x (mgr.24436) 205 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:56.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:55 smithi089 bash[26514]: cluster 2024-09-21T05:15:54.589892+0000 mgr.x (mgr.24436) 205 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:55 smithi110 bash[22020]: cluster 2024-09-21T05:15:54.589892+0000 mgr.x (mgr.24436) 205 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:58.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:57 smithi089 bash[19831]: cluster 2024-09-21T05:15:56.591508+0000 mgr.x (mgr.24436) 206 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:58.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:57 smithi089 bash[26514]: cluster 2024-09-21T05:15:56.591508+0000 mgr.x (mgr.24436) 206 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:57 smithi110 bash[22020]: cluster 2024-09-21T05:15:56.591508+0000 mgr.x (mgr.24436) 206 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:15:59.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:58 smithi089 bash[19831]: audit 2024-09-21T05:15:57.789404+0000 mgr.x (mgr.24436) 207 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:59.293 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:15:58 smithi089 bash[19831]: cluster 2024-09-21T05:15:58.592331+0000 mgr.x (mgr.24436) 208 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:59.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:58 smithi089 bash[26514]: audit 2024-09-21T05:15:57.789404+0000 mgr.x (mgr.24436) 207 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:59.293 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:15:58 smithi089 bash[26514]: cluster 2024-09-21T05:15:58.592331+0000 mgr.x (mgr.24436) 208 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:15:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:58 smithi110 bash[22020]: audit 2024-09-21T05:15:57.789404+0000 mgr.x (mgr.24436) 207 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:15:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:15:58 smithi110 bash[22020]: cluster 2024-09-21T05:15:58.592331+0000 mgr.x (mgr.24436) 208 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:02.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:01 smithi089 bash[19831]: cluster 2024-09-21T05:16:00.593190+0000 mgr.x (mgr.24436) 209 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:02.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:01 smithi089 bash[26514]: cluster 2024-09-21T05:16:00.593190+0000 mgr.x (mgr.24436) 209 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:01 smithi110 bash[22020]: cluster 2024-09-21T05:16:00.593190+0000 mgr.x (mgr.24436) 209 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:02.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:01] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.43.0" 2024-09-21T05:16:04.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:03 smithi089 bash[19831]: cluster 2024-09-21T05:16:02.594866+0000 mgr.x (mgr.24436) 210 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:04.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:03 smithi089 bash[19831]: audit 2024-09-21T05:16:02.668340+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:04.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:03 smithi089 bash[26514]: cluster 2024-09-21T05:16:02.594866+0000 mgr.x (mgr.24436) 210 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:04.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:03 smithi089 bash[26514]: audit 2024-09-21T05:16:02.668340+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:03 smithi110 bash[22020]: cluster 2024-09-21T05:16:02.594866+0000 mgr.x (mgr.24436) 210 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:03 smithi110 bash[22020]: audit 2024-09-21T05:16:02.668340+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:06.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:05 smithi089 bash[19831]: cluster 2024-09-21T05:16:04.595608+0000 mgr.x (mgr.24436) 211 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:06.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:05 smithi089 bash[26514]: cluster 2024-09-21T05:16:04.595608+0000 mgr.x (mgr.24436) 211 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:05 smithi110 bash[22020]: cluster 2024-09-21T05:16:04.595608+0000 mgr.x (mgr.24436) 211 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:08.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:07 smithi089 bash[19831]: cluster 2024-09-21T05:16:06.597162+0000 mgr.x (mgr.24436) 212 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:07 smithi089 bash[26514]: cluster 2024-09-21T05:16:06.597162+0000 mgr.x (mgr.24436) 212 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:07 smithi110 bash[22020]: cluster 2024-09-21T05:16:06.597162+0000 mgr.x (mgr.24436) 212 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:09.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:08 smithi089 bash[19831]: audit 2024-09-21T05:16:07.801050+0000 mgr.x (mgr.24436) 213 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:09.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:08 smithi089 bash[26514]: audit 2024-09-21T05:16:07.801050+0000 mgr.x (mgr.24436) 213 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:08 smithi110 bash[22020]: audit 2024-09-21T05:16:07.801050+0000 mgr.x (mgr.24436) 213 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:10.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:09 smithi089 bash[19831]: cluster 2024-09-21T05:16:08.597883+0000 mgr.x (mgr.24436) 214 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:09 smithi089 bash[26514]: cluster 2024-09-21T05:16:08.597883+0000 mgr.x (mgr.24436) 214 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:09 smithi110 bash[22020]: cluster 2024-09-21T05:16:08.597883+0000 mgr.x (mgr.24436) 214 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:11.927 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:11 smithi110 bash[22020]: cluster 2024-09-21T05:16:10.598621+0000 mgr.x (mgr.24436) 215 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:11.927 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:11] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:16:12.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:11 smithi089 bash[19831]: cluster 2024-09-21T05:16:10.598621+0000 mgr.x (mgr.24436) 215 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:12.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:11 smithi089 bash[26514]: cluster 2024-09-21T05:16:10.598621+0000 mgr.x (mgr.24436) 215 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:12.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:16:11 smithi110 bash[47061]: logger=sqlstore.transactions t=2024-09-21T05:16:11.928226318Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T05:16:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:13 smithi089 bash[19831]: cluster 2024-09-21T05:16:12.600313+0000 mgr.x (mgr.24436) 216 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:14.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:13 smithi089 bash[26514]: cluster 2024-09-21T05:16:12.600313+0000 mgr.x (mgr.24436) 216 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:13 smithi110 bash[22020]: cluster 2024-09-21T05:16:12.600313+0000 mgr.x (mgr.24436) 216 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:16.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:15 smithi089 bash[19831]: cluster 2024-09-21T05:16:14.601071+0000 mgr.x (mgr.24436) 217 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:16.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:15 smithi089 bash[26514]: cluster 2024-09-21T05:16:14.601071+0000 mgr.x (mgr.24436) 217 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:15 smithi110 bash[22020]: cluster 2024-09-21T05:16:14.601071+0000 mgr.x (mgr.24436) 217 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:17 smithi089 bash[19831]: cluster 2024-09-21T05:16:16.602652+0000 mgr.x (mgr.24436) 218 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:18.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:17 smithi089 bash[19831]: audit 2024-09-21T05:16:17.668515+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:17 smithi089 bash[26514]: cluster 2024-09-21T05:16:16.602652+0000 mgr.x (mgr.24436) 218 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:18.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:17 smithi089 bash[26514]: audit 2024-09-21T05:16:17.668515+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:17 smithi110 bash[22020]: cluster 2024-09-21T05:16:16.602652+0000 mgr.x (mgr.24436) 218 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:17 smithi110 bash[22020]: audit 2024-09-21T05:16:17.668515+0000 mon.a (mon.0) 1072 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:19.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:18 smithi089 bash[19831]: audit 2024-09-21T05:16:17.812639+0000 mgr.x (mgr.24436) 219 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:19.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:18 smithi089 bash[26514]: audit 2024-09-21T05:16:17.812639+0000 mgr.x (mgr.24436) 219 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:18 smithi110 bash[22020]: audit 2024-09-21T05:16:17.812639+0000 mgr.x (mgr.24436) 219 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:20.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:19 smithi089 bash[19831]: cluster 2024-09-21T05:16:18.603322+0000 mgr.x (mgr.24436) 220 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:20.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:19 smithi089 bash[26514]: cluster 2024-09-21T05:16:18.603322+0000 mgr.x (mgr.24436) 220 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:19 smithi110 bash[22020]: cluster 2024-09-21T05:16:18.603322+0000 mgr.x (mgr.24436) 220 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:22.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:21 smithi089 bash[19831]: cluster 2024-09-21T05:16:20.604183+0000 mgr.x (mgr.24436) 221 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:22.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:21 smithi089 bash[26514]: cluster 2024-09-21T05:16:20.604183+0000 mgr.x (mgr.24436) 221 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:21 smithi110 bash[22020]: cluster 2024-09-21T05:16:20.604183+0000 mgr.x (mgr.24436) 221 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:21] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:16:24.042 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:23 smithi089 bash[19831]: cluster 2024-09-21T05:16:22.605906+0000 mgr.x (mgr.24436) 222 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:24.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:23 smithi089 bash[26514]: cluster 2024-09-21T05:16:22.605906+0000 mgr.x (mgr.24436) 222 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:23 smithi110 bash[22020]: cluster 2024-09-21T05:16:22.605906+0000 mgr.x (mgr.24436) 222 : cluster [DBG] pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: audit 2024-09-21T05:16:24.049314+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: audit 2024-09-21T05:16:24.055578+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: cluster 2024-09-21T05:16:24.606662+0000 mgr.x (mgr.24436) 223 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: audit 2024-09-21T05:16:24.729165+0000 mon.a (mon.0) 1075 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: audit 2024-09-21T05:16:24.731224+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:25.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:25 smithi110 bash[22020]: audit 2024-09-21T05:16:24.740767+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: audit 2024-09-21T05:16:24.049314+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: audit 2024-09-21T05:16:24.055578+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: cluster 2024-09-21T05:16:24.606662+0000 mgr.x (mgr.24436) 223 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: audit 2024-09-21T05:16:24.729165+0000 mon.a (mon.0) 1075 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: audit 2024-09-21T05:16:24.731224+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[19831]: audit 2024-09-21T05:16:24.740767+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: audit 2024-09-21T05:16:24.049314+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: audit 2024-09-21T05:16:24.055578+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:25.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: cluster 2024-09-21T05:16:24.606662+0000 mgr.x (mgr.24436) 223 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:25.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: audit 2024-09-21T05:16:24.729165+0000 mon.a (mon.0) 1075 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:16:25.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: audit 2024-09-21T05:16:24.731224+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:16:25.544 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:25 smithi089 bash[26514]: audit 2024-09-21T05:16:24.740767+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:16:28.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:27 smithi089 bash[26514]: cluster 2024-09-21T05:16:26.608280+0000 mgr.x (mgr.24436) 224 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:28.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:27 smithi089 bash[19831]: cluster 2024-09-21T05:16:26.608280+0000 mgr.x (mgr.24436) 224 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:27 smithi110 bash[22020]: cluster 2024-09-21T05:16:26.608280+0000 mgr.x (mgr.24436) 224 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:29.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:28 smithi089 bash[26514]: audit 2024-09-21T05:16:27.824170+0000 mgr.x (mgr.24436) 225 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:29.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:28 smithi089 bash[19831]: audit 2024-09-21T05:16:27.824170+0000 mgr.x (mgr.24436) 225 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:28 smithi110 bash[22020]: audit 2024-09-21T05:16:27.824170+0000 mgr.x (mgr.24436) 225 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:30.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:29 smithi089 bash[26514]: cluster 2024-09-21T05:16:28.609002+0000 mgr.x (mgr.24436) 226 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:30.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:29 smithi089 bash[19831]: cluster 2024-09-21T05:16:28.609002+0000 mgr.x (mgr.24436) 226 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:29 smithi110 bash[22020]: cluster 2024-09-21T05:16:28.609002+0000 mgr.x (mgr.24436) 226 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:32.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:31 smithi089 bash[19831]: cluster 2024-09-21T05:16:30.609742+0000 mgr.x (mgr.24436) 227 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:32.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:31 smithi089 bash[26514]: cluster 2024-09-21T05:16:30.609742+0000 mgr.x (mgr.24436) 227 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:31 smithi110 bash[22020]: cluster 2024-09-21T05:16:30.609742+0000 mgr.x (mgr.24436) 227 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:32.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:31] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:16:33.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:33 smithi089 bash[19831]: cluster 2024-09-21T05:16:32.611442+0000 mgr.x (mgr.24436) 228 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:33.543 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:33 smithi089 bash[19831]: audit 2024-09-21T05:16:32.668686+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:33.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:33 smithi089 bash[26514]: cluster 2024-09-21T05:16:32.611442+0000 mgr.x (mgr.24436) 228 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:33.543 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:33 smithi089 bash[26514]: audit 2024-09-21T05:16:32.668686+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:33 smithi110 bash[22020]: cluster 2024-09-21T05:16:32.611442+0000 mgr.x (mgr.24436) 228 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:33 smithi110 bash[22020]: audit 2024-09-21T05:16:32.668686+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:36.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:35 smithi089 bash[19831]: cluster 2024-09-21T05:16:34.612194+0000 mgr.x (mgr.24436) 229 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:36.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:35 smithi089 bash[26514]: cluster 2024-09-21T05:16:34.612194+0000 mgr.x (mgr.24436) 229 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:35 smithi110 bash[22020]: cluster 2024-09-21T05:16:34.612194+0000 mgr.x (mgr.24436) 229 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:38.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:37 smithi089 bash[19831]: cluster 2024-09-21T05:16:36.613799+0000 mgr.x (mgr.24436) 230 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:38.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:37 smithi089 bash[26514]: cluster 2024-09-21T05:16:36.613799+0000 mgr.x (mgr.24436) 230 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:37 smithi110 bash[22020]: cluster 2024-09-21T05:16:36.613799+0000 mgr.x (mgr.24436) 230 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:39.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:38 smithi089 bash[19831]: audit 2024-09-21T05:16:37.835749+0000 mgr.x (mgr.24436) 231 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:39.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:38 smithi089 bash[26514]: audit 2024-09-21T05:16:37.835749+0000 mgr.x (mgr.24436) 231 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:38 smithi110 bash[22020]: audit 2024-09-21T05:16:37.835749+0000 mgr.x (mgr.24436) 231 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:40.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:39 smithi089 bash[19831]: cluster 2024-09-21T05:16:38.614568+0000 mgr.x (mgr.24436) 232 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:40.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:39 smithi089 bash[26514]: cluster 2024-09-21T05:16:38.614568+0000 mgr.x (mgr.24436) 232 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:39 smithi110 bash[22020]: cluster 2024-09-21T05:16:38.614568+0000 mgr.x (mgr.24436) 232 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:42.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:41 smithi089 bash[19831]: cluster 2024-09-21T05:16:40.615325+0000 mgr.x (mgr.24436) 233 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:42.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:41 smithi089 bash[26514]: cluster 2024-09-21T05:16:40.615325+0000 mgr.x (mgr.24436) 233 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:41 smithi110 bash[22020]: cluster 2024-09-21T05:16:40.615325+0000 mgr.x (mgr.24436) 233 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:42.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:41] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.43.0" 2024-09-21T05:16:44.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:43 smithi089 bash[26514]: cluster 2024-09-21T05:16:42.616989+0000 mgr.x (mgr.24436) 234 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:44.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:43 smithi089 bash[19831]: cluster 2024-09-21T05:16:42.616989+0000 mgr.x (mgr.24436) 234 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:43 smithi110 bash[22020]: cluster 2024-09-21T05:16:42.616989+0000 mgr.x (mgr.24436) 234 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:46.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:45 smithi089 bash[19831]: cluster 2024-09-21T05:16:44.617712+0000 mgr.x (mgr.24436) 235 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:46.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:45 smithi089 bash[26514]: cluster 2024-09-21T05:16:44.617712+0000 mgr.x (mgr.24436) 235 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:45 smithi110 bash[22020]: cluster 2024-09-21T05:16:44.617712+0000 mgr.x (mgr.24436) 235 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:47 smithi089 bash[19831]: cluster 2024-09-21T05:16:46.619277+0000 mgr.x (mgr.24436) 236 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:48.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:47 smithi089 bash[19831]: audit 2024-09-21T05:16:47.669180+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:48.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:47 smithi089 bash[26514]: cluster 2024-09-21T05:16:46.619277+0000 mgr.x (mgr.24436) 236 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:48.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:47 smithi089 bash[26514]: audit 2024-09-21T05:16:47.669180+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:47 smithi110 bash[22020]: cluster 2024-09-21T05:16:46.619277+0000 mgr.x (mgr.24436) 236 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:47 smithi110 bash[22020]: audit 2024-09-21T05:16:47.669180+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:16:49.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:48 smithi089 bash[19831]: audit 2024-09-21T05:16:47.847291+0000 mgr.x (mgr.24436) 237 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:49.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:48 smithi089 bash[26514]: audit 2024-09-21T05:16:47.847291+0000 mgr.x (mgr.24436) 237 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:48 smithi110 bash[22020]: audit 2024-09-21T05:16:47.847291+0000 mgr.x (mgr.24436) 237 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:50.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:49 smithi089 bash[19831]: cluster 2024-09-21T05:16:48.619994+0000 mgr.x (mgr.24436) 238 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:50.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:49 smithi089 bash[26514]: cluster 2024-09-21T05:16:48.619994+0000 mgr.x (mgr.24436) 238 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:49 smithi110 bash[22020]: cluster 2024-09-21T05:16:48.619994+0000 mgr.x (mgr.24436) 238 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:52.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:51 smithi089 bash[19831]: cluster 2024-09-21T05:16:50.620703+0000 mgr.x (mgr.24436) 239 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:52.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:51 smithi089 bash[26514]: cluster 2024-09-21T05:16:50.620703+0000 mgr.x (mgr.24436) 239 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:51 smithi110 bash[22020]: cluster 2024-09-21T05:16:50.620703+0000 mgr.x (mgr.24436) 239 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:52.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:16:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:16:51] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:16:54.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:53 smithi089 bash[19831]: cluster 2024-09-21T05:16:52.622398+0000 mgr.x (mgr.24436) 240 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:54.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:53 smithi089 bash[26514]: cluster 2024-09-21T05:16:52.622398+0000 mgr.x (mgr.24436) 240 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:53 smithi110 bash[22020]: cluster 2024-09-21T05:16:52.622398+0000 mgr.x (mgr.24436) 240 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:56.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:55 smithi089 bash[19831]: cluster 2024-09-21T05:16:54.623129+0000 mgr.x (mgr.24436) 241 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:56.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:55 smithi089 bash[26514]: cluster 2024-09-21T05:16:54.623129+0000 mgr.x (mgr.24436) 241 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:55 smithi110 bash[22020]: cluster 2024-09-21T05:16:54.623129+0000 mgr.x (mgr.24436) 241 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:16:58.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:57 smithi089 bash[19831]: cluster 2024-09-21T05:16:56.624716+0000 mgr.x (mgr.24436) 242 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:58.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:57 smithi089 bash[26514]: cluster 2024-09-21T05:16:56.624716+0000 mgr.x (mgr.24436) 242 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:57 smithi110 bash[22020]: cluster 2024-09-21T05:16:56.624716+0000 mgr.x (mgr.24436) 242 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:16:59.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:58 smithi089 bash[19831]: audit 2024-09-21T05:16:57.850359+0000 mgr.x (mgr.24436) 243 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:59.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:58 smithi089 bash[26514]: audit 2024-09-21T05:16:57.850359+0000 mgr.x (mgr.24436) 243 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:16:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:58 smithi110 bash[22020]: audit 2024-09-21T05:16:57.850359+0000 mgr.x (mgr.24436) 243 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:00.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:16:59 smithi089 bash[19831]: cluster 2024-09-21T05:16:58.625401+0000 mgr.x (mgr.24436) 244 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:00.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:16:59 smithi089 bash[26514]: cluster 2024-09-21T05:16:58.625401+0000 mgr.x (mgr.24436) 244 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:16:59 smithi110 bash[22020]: cluster 2024-09-21T05:16:58.625401+0000 mgr.x (mgr.24436) 244 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:02.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:01 smithi089 bash[19831]: cluster 2024-09-21T05:17:00.626119+0000 mgr.x (mgr.24436) 245 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:02.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:01 smithi089 bash[26514]: cluster 2024-09-21T05:17:00.626119+0000 mgr.x (mgr.24436) 245 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:01 smithi110 bash[22020]: cluster 2024-09-21T05:17:00.626119+0000 mgr.x (mgr.24436) 245 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:02.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:01] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:17:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:03 smithi089 bash[19831]: cluster 2024-09-21T05:17:02.627922+0000 mgr.x (mgr.24436) 246 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:03.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:03 smithi089 bash[19831]: audit 2024-09-21T05:17:02.669105+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:03 smithi089 bash[26514]: cluster 2024-09-21T05:17:02.627922+0000 mgr.x (mgr.24436) 246 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:03.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:03 smithi089 bash[26514]: audit 2024-09-21T05:17:02.669105+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:03 smithi110 bash[22020]: cluster 2024-09-21T05:17:02.627922+0000 mgr.x (mgr.24436) 246 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:03.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:03 smithi110 bash[22020]: audit 2024-09-21T05:17:02.669105+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:06.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:05 smithi089 bash[19831]: cluster 2024-09-21T05:17:04.628633+0000 mgr.x (mgr.24436) 247 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:06.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:05 smithi089 bash[26514]: cluster 2024-09-21T05:17:04.628633+0000 mgr.x (mgr.24436) 247 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:05 smithi110 bash[22020]: cluster 2024-09-21T05:17:04.628633+0000 mgr.x (mgr.24436) 247 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:08.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:07 smithi089 bash[26514]: cluster 2024-09-21T05:17:06.630219+0000 mgr.x (mgr.24436) 248 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:08.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:07 smithi089 bash[19831]: cluster 2024-09-21T05:17:06.630219+0000 mgr.x (mgr.24436) 248 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:07 smithi110 bash[22020]: cluster 2024-09-21T05:17:06.630219+0000 mgr.x (mgr.24436) 248 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:09.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:08 smithi089 bash[19831]: audit 2024-09-21T05:17:07.861952+0000 mgr.x (mgr.24436) 249 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:09.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:08 smithi089 bash[26514]: audit 2024-09-21T05:17:07.861952+0000 mgr.x (mgr.24436) 249 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:08 smithi110 bash[22020]: audit 2024-09-21T05:17:07.861952+0000 mgr.x (mgr.24436) 249 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:10.043 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:09 smithi089 bash[26514]: cluster 2024-09-21T05:17:08.630940+0000 mgr.x (mgr.24436) 250 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:10.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:09 smithi089 bash[19831]: cluster 2024-09-21T05:17:08.630940+0000 mgr.x (mgr.24436) 250 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:09 smithi110 bash[22020]: cluster 2024-09-21T05:17:08.630940+0000 mgr.x (mgr.24436) 250 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:12.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:11 smithi089 bash[19831]: cluster 2024-09-21T05:17:10.631788+0000 mgr.x (mgr.24436) 251 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:12.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:11 smithi089 bash[26514]: cluster 2024-09-21T05:17:10.631788+0000 mgr.x (mgr.24436) 251 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:11 smithi110 bash[22020]: cluster 2024-09-21T05:17:10.631788+0000 mgr.x (mgr.24436) 251 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:12.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:11] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.43.0" 2024-09-21T05:17:14.043 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:13 smithi089 bash[19831]: cluster 2024-09-21T05:17:12.633607+0000 mgr.x (mgr.24436) 252 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:14.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:13 smithi089 bash[26514]: cluster 2024-09-21T05:17:12.633607+0000 mgr.x (mgr.24436) 252 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:13 smithi110 bash[22020]: cluster 2024-09-21T05:17:12.633607+0000 mgr.x (mgr.24436) 252 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:16.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:15 smithi089 bash[19831]: cluster 2024-09-21T05:17:14.634434+0000 mgr.x (mgr.24436) 253 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:16.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:15 smithi089 bash[26514]: cluster 2024-09-21T05:17:14.634434+0000 mgr.x (mgr.24436) 253 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:15 smithi110 bash[22020]: cluster 2024-09-21T05:17:14.634434+0000 mgr.x (mgr.24436) 253 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:18.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:17 smithi089 bash[19831]: cluster 2024-09-21T05:17:16.636065+0000 mgr.x (mgr.24436) 254 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:18.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:17 smithi089 bash[19831]: audit 2024-09-21T05:17:17.669215+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:18.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:17 smithi089 bash[26514]: cluster 2024-09-21T05:17:16.636065+0000 mgr.x (mgr.24436) 254 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:18.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:17 smithi089 bash[26514]: audit 2024-09-21T05:17:17.669215+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:17 smithi110 bash[22020]: cluster 2024-09-21T05:17:16.636065+0000 mgr.x (mgr.24436) 254 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:17 smithi110 bash[22020]: audit 2024-09-21T05:17:17.669215+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:19.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:18 smithi089 bash[19831]: audit 2024-09-21T05:17:17.873507+0000 mgr.x (mgr.24436) 255 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:19.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:18 smithi089 bash[26514]: audit 2024-09-21T05:17:17.873507+0000 mgr.x (mgr.24436) 255 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:18 smithi110 bash[22020]: audit 2024-09-21T05:17:17.873507+0000 mgr.x (mgr.24436) 255 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:20.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:19 smithi089 bash[19831]: cluster 2024-09-21T05:17:18.636828+0000 mgr.x (mgr.24436) 256 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:20.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:19 smithi089 bash[26514]: cluster 2024-09-21T05:17:18.636828+0000 mgr.x (mgr.24436) 256 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:19 smithi110 bash[22020]: cluster 2024-09-21T05:17:18.636828+0000 mgr.x (mgr.24436) 256 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:22.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:21 smithi089 bash[19831]: cluster 2024-09-21T05:17:20.637713+0000 mgr.x (mgr.24436) 257 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:22.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:21 smithi089 bash[26514]: cluster 2024-09-21T05:17:20.637713+0000 mgr.x (mgr.24436) 257 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:21] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:17:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:21 smithi110 bash[22020]: cluster 2024-09-21T05:17:20.637713+0000 mgr.x (mgr.24436) 257 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:24.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:23 smithi089 bash[26514]: cluster 2024-09-21T05:17:22.639499+0000 mgr.x (mgr.24436) 258 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:24.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:23 smithi089 bash[19831]: cluster 2024-09-21T05:17:22.639499+0000 mgr.x (mgr.24436) 258 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:23 smithi110 bash[22020]: cluster 2024-09-21T05:17:22.639499+0000 mgr.x (mgr.24436) 258 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[19831]: cluster 2024-09-21T05:17:24.640331+0000 mgr.x (mgr.24436) 259 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[19831]: audit 2024-09-21T05:17:25.578178+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[19831]: audit 2024-09-21T05:17:25.580044+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[19831]: audit 2024-09-21T05:17:25.590213+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[26514]: cluster 2024-09-21T05:17:24.640331+0000 mgr.x (mgr.24436) 259 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:26.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[26514]: audit 2024-09-21T05:17:25.578178+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:26.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[26514]: audit 2024-09-21T05:17:25.580044+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:26.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:25 smithi089 bash[26514]: audit 2024-09-21T05:17:25.590213+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:17:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:25 smithi110 bash[22020]: cluster 2024-09-21T05:17:24.640331+0000 mgr.x (mgr.24436) 259 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:25 smithi110 bash[22020]: audit 2024-09-21T05:17:25.578178+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:17:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:25 smithi110 bash[22020]: audit 2024-09-21T05:17:25.580044+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:17:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:25 smithi110 bash[22020]: audit 2024-09-21T05:17:25.590213+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' 2024-09-21T05:17:28.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:27 smithi089 bash[19831]: cluster 2024-09-21T05:17:26.641923+0000 mgr.x (mgr.24436) 260 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:28.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:27 smithi089 bash[26514]: cluster 2024-09-21T05:17:26.641923+0000 mgr.x (mgr.24436) 260 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:27 smithi110 bash[22020]: cluster 2024-09-21T05:17:26.641923+0000 mgr.x (mgr.24436) 260 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:29.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:28 smithi089 bash[19831]: audit 2024-09-21T05:17:27.884569+0000 mgr.x (mgr.24436) 261 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:29.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:28 smithi089 bash[26514]: audit 2024-09-21T05:17:27.884569+0000 mgr.x (mgr.24436) 261 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:28 smithi110 bash[22020]: audit 2024-09-21T05:17:27.884569+0000 mgr.x (mgr.24436) 261 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:30.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:29 smithi089 bash[19831]: cluster 2024-09-21T05:17:28.642601+0000 mgr.x (mgr.24436) 262 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:30.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:29 smithi089 bash[26514]: cluster 2024-09-21T05:17:28.642601+0000 mgr.x (mgr.24436) 262 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:29 smithi110 bash[22020]: cluster 2024-09-21T05:17:28.642601+0000 mgr.x (mgr.24436) 262 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:31.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:17:32.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:31 smithi089 bash[19831]: cluster 2024-09-21T05:17:30.643279+0000 mgr.x (mgr.24436) 263 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:32.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:31 smithi089 bash[26514]: cluster 2024-09-21T05:17:30.643279+0000 mgr.x (mgr.24436) 263 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:31 smithi110 bash[22020]: cluster 2024-09-21T05:17:30.643279+0000 mgr.x (mgr.24436) 263 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:32.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:31] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:17:33.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:32 smithi089 bash[19831]: audit 2024-09-21T05:17:32.669444+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:33.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:32 smithi089 bash[26514]: audit 2024-09-21T05:17:32.669444+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:32 smithi110 bash[22020]: audit 2024-09-21T05:17:32.669444+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:34.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:33 smithi089 bash[19831]: cluster 2024-09-21T05:17:32.644955+0000 mgr.x (mgr.24436) 264 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:34.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:33 smithi089 bash[26514]: cluster 2024-09-21T05:17:32.644955+0000 mgr.x (mgr.24436) 264 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:33 smithi110 bash[22020]: cluster 2024-09-21T05:17:32.644955+0000 mgr.x (mgr.24436) 264 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:35.857 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:17:36.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:35 smithi089 bash[19831]: cluster 2024-09-21T05:17:34.645661+0000 mgr.x (mgr.24436) 265 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:36.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:35 smithi089 bash[26514]: cluster 2024-09-21T05:17:34.645661+0000 mgr.x (mgr.24436) 265 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:35 smithi110 bash[22020]: cluster 2024-09-21T05:17:34.645661+0000 mgr.x (mgr.24436) 265 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:37.319 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:17:37.319 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (16m) 73s ago 17m 14.3M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:17:37.319 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (16m) 2m ago 16m 75.3M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:17:37.319 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (6m) 73s ago 14m 48.1M - 3.8 164465d2334a 248332c6f564 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (9m) 2m ago 25m 502M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (2m) 73s ago 27m 438M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (27m) 73s ago 27m 67.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (25m) 2m ago 25m 47.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (25m) 73s ago 25m 49.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (17m) 73s ago 17m 8748k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (17m) 2m ago 17m 8915k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (24m) 73s ago 24m 55.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (23m) 73s ago 23m 64.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (22m) 73s ago 22m 60.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (21m) 73s ago 22m 54.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (21m) 2m ago 21m 68.9M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (20m) 2m ago 20m 53.0M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:17:37.320 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (19m) 2m ago 19m 60.6M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:17:37.321 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (18m) 2m ago 18m 61.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:17:37.321 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (6m) 2m ago 17m 44.8M - 2.43.0 a07b618ecd1d 1ccd3bbec32d 2024-09-21T05:17:37.321 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (14m) 73s ago 14m 98.8M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:17:37.321 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (14m) 2m ago 14m 98.0M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:17:37.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions' 2024-09-21T05:17:38.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:37 smithi089 bash[19831]: cluster 2024-09-21T05:17:36.647231+0000 mgr.x (mgr.24436) 266 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:38.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:37 smithi089 bash[26514]: cluster 2024-09-21T05:17:36.647231+0000 mgr.x (mgr.24436) 266 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:37 smithi110 bash[22020]: cluster 2024-09-21T05:17:36.647231+0000 mgr.x (mgr.24436) 266 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:39.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:38 smithi089 bash[19831]: audit 2024-09-21T05:17:37.281958+0000 mgr.x (mgr.24436) 267 : audit [DBG] from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:39.044 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:38 smithi089 bash[19831]: audit 2024-09-21T05:17:37.892750+0000 mgr.x (mgr.24436) 268 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:39.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:38 smithi089 bash[26514]: audit 2024-09-21T05:17:37.281958+0000 mgr.x (mgr.24436) 267 : audit [DBG] from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:39.044 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:38 smithi089 bash[26514]: audit 2024-09-21T05:17:37.892750+0000 mgr.x (mgr.24436) 268 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:38 smithi110 bash[22020]: audit 2024-09-21T05:17:37.281958+0000 mgr.x (mgr.24436) 267 : audit [DBG] from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:17:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:38 smithi110 bash[22020]: audit 2024-09-21T05:17:37.892750+0000 mgr.x (mgr.24436) 268 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:39 smithi110 bash[22020]: cluster 2024-09-21T05:17:38.647970+0000 mgr.x (mgr.24436) 269 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:40.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:39 smithi089 bash[19831]: cluster 2024-09-21T05:17:38.647970+0000 mgr.x (mgr.24436) 269 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:40.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:39 smithi089 bash[26514]: cluster 2024-09-21T05:17:38.647970+0000 mgr.x (mgr.24436) 269 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:41 smithi110 bash[22020]: cluster 2024-09-21T05:17:40.648679+0000 mgr.x (mgr.24436) 270 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:42.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:41] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:17:42.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:41 smithi089 bash[19831]: cluster 2024-09-21T05:17:40.648679+0000 mgr.x (mgr.24436) 270 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:42.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:41 smithi089 bash[26514]: cluster 2024-09-21T05:17:40.648679+0000 mgr.x (mgr.24436) 270 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:42.793 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:17:44.255 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:17:44.255 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:17:44.255 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:17:44.256 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:17:44.257 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:17:44.267 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:43 smithi089 bash[19831]: cluster 2024-09-21T05:17:42.650257+0000 mgr.x (mgr.24436) 271 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:44.267 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:43 smithi089 bash[26514]: cluster 2024-09-21T05:17:42.650257+0000 mgr.x (mgr.24436) 271 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:43 smithi110 bash[22020]: cluster 2024-09-21T05:17:42.650257+0000 mgr.x (mgr.24436) 271 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:44.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:17:45.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:44 smithi089 bash[19831]: audit 2024-09-21T05:17:44.258126+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.89:0/1678329882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:17:45.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:44 smithi089 bash[26514]: audit 2024-09-21T05:17:44.258126+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.89:0/1678329882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:17:45.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:44 smithi110 bash[22020]: audit 2024-09-21T05:17:44.258126+0000 mon.a (mon.0) 1086 : audit [DBG] from='client.? 172.21.15.89:0/1678329882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:17:46.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:45 smithi089 bash[26514]: cluster 2024-09-21T05:17:44.650985+0000 mgr.x (mgr.24436) 272 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:46.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:45 smithi089 bash[19831]: cluster 2024-09-21T05:17:44.650985+0000 mgr.x (mgr.24436) 272 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:45 smithi110 bash[22020]: cluster 2024-09-21T05:17:44.650985+0000 mgr.x (mgr.24436) 272 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:48.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:47 smithi089 bash[19831]: cluster 2024-09-21T05:17:46.652596+0000 mgr.x (mgr.24436) 273 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:48.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:47 smithi089 bash[19831]: audit 2024-09-21T05:17:47.669564+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:48.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:47 smithi089 bash[26514]: cluster 2024-09-21T05:17:46.652596+0000 mgr.x (mgr.24436) 273 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:48.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:47 smithi089 bash[26514]: audit 2024-09-21T05:17:47.669564+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:47 smithi110 bash[22020]: cluster 2024-09-21T05:17:46.652596+0000 mgr.x (mgr.24436) 273 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:47 smithi110 bash[22020]: audit 2024-09-21T05:17:47.669564+0000 mon.a (mon.0) 1087 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:17:49.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:48 smithi089 bash[19831]: audit 2024-09-21T05:17:47.904238+0000 mgr.x (mgr.24436) 274 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:49.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:48 smithi089 bash[26514]: audit 2024-09-21T05:17:47.904238+0000 mgr.x (mgr.24436) 274 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:49.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:48 smithi110 bash[22020]: audit 2024-09-21T05:17:47.904238+0000 mgr.x (mgr.24436) 274 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:49.781 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:17:50.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:49 smithi089 bash[19831]: cluster 2024-09-21T05:17:48.653299+0000 mgr.x (mgr.24436) 275 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:50.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:49 smithi089 bash[26514]: cluster 2024-09-21T05:17:48.653299+0000 mgr.x (mgr.24436) 275 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:49 smithi110 bash[22020]: cluster 2024-09-21T05:17:48.653299+0000 mgr.x (mgr.24436) 275 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:51.318 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:17:52.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph -s' 2024-09-21T05:17:52.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:51 smithi089 bash[19831]: cluster 2024-09-21T05:17:50.654042+0000 mgr.x (mgr.24436) 276 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:52.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:51 smithi089 bash[19831]: audit 2024-09-21T05:17:51.321178+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.89:0/2821736587' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:17:52.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:51 smithi089 bash[26514]: cluster 2024-09-21T05:17:50.654042+0000 mgr.x (mgr.24436) 276 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:52.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:51 smithi089 bash[26514]: audit 2024-09-21T05:17:51.321178+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.89:0/2821736587' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:17:52.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:17:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:17:51] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:17:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:51 smithi110 bash[22020]: cluster 2024-09-21T05:17:50.654042+0000 mgr.x (mgr.24436) 276 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:51 smithi110 bash[22020]: audit 2024-09-21T05:17:51.321178+0000 mon.a (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.89:0/2821736587' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:17:54.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:53 smithi089 bash[19831]: cluster 2024-09-21T05:17:52.655744+0000 mgr.x (mgr.24436) 277 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:54.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:53 smithi089 bash[26514]: cluster 2024-09-21T05:17:52.655744+0000 mgr.x (mgr.24436) 277 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:53 smithi110 bash[22020]: cluster 2024-09-21T05:17:52.655744+0000 mgr.x (mgr.24436) 277 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:56.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:55 smithi089 bash[19831]: cluster 2024-09-21T05:17:54.656536+0000 mgr.x (mgr.24436) 278 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:56.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:55 smithi089 bash[26514]: cluster 2024-09-21T05:17:54.656536+0000 mgr.x (mgr.24436) 278 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:56.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:55 smithi110 bash[22020]: cluster 2024-09-21T05:17:54.656536+0000 mgr.x (mgr.24436) 278 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:17:56.825 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:17:58.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:57 smithi089 bash[19831]: cluster 2024-09-21T05:17:56.658226+0000 mgr.x (mgr.24436) 279 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:58.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:57 smithi089 bash[26514]: cluster 2024-09-21T05:17:56.658226+0000 mgr.x (mgr.24436) 279 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:57 smithi110 bash[22020]: cluster 2024-09-21T05:17:56.658226+0000 mgr.x (mgr.24436) 279 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:17:58.320 INFO:teuthology.orchestra.run.smithi089.stdout: cluster: 2024-09-21T05:17:58.320 INFO:teuthology.orchestra.run.smithi089.stdout: id: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: health: HEALTH_OK 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: services: 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: mon: 3 daemons, quorum a,b,c (age 26m) 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: mgr: x(active, since 6m), standbys: y 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: osd: 8 osds: 8 up (since 18m), 8 in (since 19m) 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: data: 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: pools: 6 pools, 161 pgs 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: objects: 244 objects, 585 KiB 2024-09-21T05:17:58.321 INFO:teuthology.orchestra.run.smithi089.stdout: usage: 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:17:58.322 INFO:teuthology.orchestra.run.smithi089.stdout: pgs: 161 active+clean 2024-09-21T05:17:58.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:17:58.322 INFO:teuthology.orchestra.run.smithi089.stdout: io: 2024-09-21T05:17:58.322 INFO:teuthology.orchestra.run.smithi089.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-09-21T05:17:58.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:17:59.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph mgr fail' 2024-09-21T05:17:59.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:58 smithi089 bash[19831]: audit 2024-09-21T05:17:57.914323+0000 mgr.x (mgr.24436) 280 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:59.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:58 smithi089 bash[19831]: audit 2024-09-21T05:17:58.323212+0000 mon.c (mon.2) 170 : audit [DBG] from='client.? 172.21.15.89:0/3718456157' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:17:59.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:58 smithi089 bash[26514]: audit 2024-09-21T05:17:57.914323+0000 mgr.x (mgr.24436) 280 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:59.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:58 smithi089 bash[26514]: audit 2024-09-21T05:17:58.323212+0000 mon.c (mon.2) 170 : audit [DBG] from='client.? 172.21.15.89:0/3718456157' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:17:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:58 smithi110 bash[22020]: audit 2024-09-21T05:17:57.914323+0000 mgr.x (mgr.24436) 280 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:17:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:58 smithi110 bash[22020]: audit 2024-09-21T05:17:58.323212+0000 mon.c (mon.2) 170 : audit [DBG] from='client.? 172.21.15.89:0/3718456157' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:18:00.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:17:59 smithi089 bash[19831]: cluster 2024-09-21T05:17:58.659089+0000 mgr.x (mgr.24436) 281 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:00.294 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:17:59 smithi089 bash[26514]: cluster 2024-09-21T05:17:58.659089+0000 mgr.x (mgr.24436) 281 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:17:59 smithi110 bash[22020]: cluster 2024-09-21T05:17:58.659089+0000 mgr.x (mgr.24436) 281 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:02.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:01 smithi089 bash[19831]: cluster 2024-09-21T05:18:00.659967+0000 mgr.x (mgr.24436) 282 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:02.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:01 smithi089 bash[26514]: cluster 2024-09-21T05:18:00.659967+0000 mgr.x (mgr.24436) 282 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:01 smithi110 bash[22020]: cluster 2024-09-21T05:18:00.659967+0000 mgr.x (mgr.24436) 282 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:02.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:01] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:18:03.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:02 smithi089 bash[19831]: audit 2024-09-21T05:18:02.669679+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:03.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:02 smithi089 bash[26514]: audit 2024-09-21T05:18:02.669679+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:03.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:02 smithi110 bash[22020]: audit 2024-09-21T05:18:02.669679+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.24436 172.21.15.110:0/896368150' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:03.855 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:18:04.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:03 smithi089 bash[19831]: cluster 2024-09-21T05:18:02.661685+0000 mgr.x (mgr.24436) 283 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:04.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:03 smithi089 bash[26514]: cluster 2024-09-21T05:18:02.661685+0000 mgr.x (mgr.24436) 283 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:03 smithi110 bash[22020]: cluster 2024-09-21T05:18:02.661685+0000 mgr.x (mgr.24436) 283 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:05.794 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[68019]: [21/Sep/2024:05:18:05] ENGINE Bus STOPPING 2024-09-21T05:18:05.794 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[68019]: [21/Sep/2024:05:18:05] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:18:05.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[68019]: [21/Sep/2024:05:18:05] ENGINE Bus STOPPED 2024-09-21T05:18:05.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[50043]: ignoring --setuser ceph since I am not root 2024-09-21T05:18:05.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[50043]: ignoring --setgroup ceph since I am not root 2024-09-21T05:18:05.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[50043]: debug 2024-09-21T05:18:05.390+0000 7f077d619640 1 -- 172.21.15.110:0/2761450805 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56375cf3f0e0 con 0x56375cf40800 2024-09-21T05:18:06.061 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: cluster 2024-09-21T05:18:04.662366+0000 mgr.x (mgr.24436) 284 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.321775+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: cluster 2024-09-21T05:18:05.322571+0000 mon.a (mon.0) 1091 : cluster [INF] Activating manager daemon y 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.326855+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: cluster 2024-09-21T05:18:05.334714+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: cluster 2024-09-21T05:18:05.335106+0000 mon.a (mon.0) 1094 : cluster [DBG] mgrmap e29: y(active, starting, since 0.0125366s) 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.339281+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.339407+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.339512+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.339776+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340032+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340194+0000 mon.a (mon.0) 1100 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:18:06.157 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340339+0000 mon.a (mon.0) 1101 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340550+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340714+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.340885+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.341064+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.341238+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.341547+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: cluster 2024-09-21T05:18:04.662366+0000 mgr.x (mgr.24436) 284 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.321775+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: cluster 2024-09-21T05:18:05.322571+0000 mon.a (mon.0) 1091 : cluster [INF] Activating manager daemon y 2024-09-21T05:18:06.158 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.326855+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: cluster 2024-09-21T05:18:05.334714+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: cluster 2024-09-21T05:18:05.335106+0000 mon.a (mon.0) 1094 : cluster [DBG] mgrmap e29: y(active, starting, since 0.0125366s) 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.339281+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.339407+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.339512+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.339776+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340032+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340194+0000 mon.a (mon.0) 1100 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340339+0000 mon.a (mon.0) 1101 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340550+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340714+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.340885+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.341064+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.341238+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:18:06.159 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.341547+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.341713+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: audit 2024-09-21T05:18:05.342101+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[26514]: cluster 2024-09-21T05:18:05.617143+0000 mon.a (mon.0) 1110 : cluster [INF] Manager daemon y is now available 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.341713+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: audit 2024-09-21T05:18:05.342101+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:05 smithi089 bash[19831]: cluster 2024-09-21T05:18:05.617143+0000 mon.a (mon.0) 1110 : cluster [INF] Manager daemon y is now available 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: cluster 2024-09-21T05:18:04.662366+0000 mgr.x (mgr.24436) 284 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:06.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.321775+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: cluster 2024-09-21T05:18:05.322571+0000 mon.a (mon.0) 1091 : cluster [INF] Activating manager daemon y 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.326855+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.89:0/979146725' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: cluster 2024-09-21T05:18:05.334714+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: cluster 2024-09-21T05:18:05.335106+0000 mon.a (mon.0) 1094 : cluster [DBG] mgrmap e29: y(active, starting, since 0.0125366s) 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.339281+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.339407+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.339512+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.339776+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340032+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340194+0000 mon.a (mon.0) 1100 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340339+0000 mon.a (mon.0) 1101 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340550+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340714+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:18:06.161 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.340885+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.341064+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.341238+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.341547+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.341713+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: audit 2024-09-21T05:18:05.342101+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:18:06.162 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:05 smithi110 bash[22020]: cluster 2024-09-21T05:18:05.617143+0000 mon.a (mon.0) 1110 : cluster [INF] Manager daemon y is now available 2024-09-21T05:18:06.794 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[68019]: [21/Sep/2024:05:18:06] ENGINE Bus STARTING 2024-09-21T05:18:06.794 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[68019]: [21/Sep/2024:05:18:06] ENGINE Serving on http://:::9283 2024-09-21T05:18:06.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[68019]: [21/Sep/2024:05:18:06] ENGINE Bus STARTED 2024-09-21T05:18:07.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: audit 2024-09-21T05:18:05.964901+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:07.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: audit 2024-09-21T05:18:05.965178+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.294 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: audit 2024-09-21T05:18:05.977180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: audit 2024-09-21T05:18:06.017040+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: cluster 2024-09-21T05:18:06.335333+0000 mon.a (mon.0) 1115 : cluster [DBG] mgrmap e30: y(active, since 1.01276s) 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: audit 2024-09-21T05:18:06.365171+0000 mgr.y (mgr.25016) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[19831]: cluster 2024-09-21T05:18:06.368947+0000 mgr.y (mgr.25016) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: audit 2024-09-21T05:18:05.964901+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: audit 2024-09-21T05:18:05.965178+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: audit 2024-09-21T05:18:05.977180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: audit 2024-09-21T05:18:06.017040+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: cluster 2024-09-21T05:18:06.335333+0000 mon.a (mon.0) 1115 : cluster [DBG] mgrmap e30: y(active, since 1.01276s) 2024-09-21T05:18:07.295 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: audit 2024-09-21T05:18:06.365171+0000 mgr.y (mgr.25016) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:06 smithi089 bash[26514]: cluster 2024-09-21T05:18:06.368947+0000 mgr.y (mgr.25016) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: audit 2024-09-21T05:18:05.964901+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: audit 2024-09-21T05:18:05.965178+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: audit 2024-09-21T05:18:05.977180+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: audit 2024-09-21T05:18:06.017040+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: cluster 2024-09-21T05:18:06.335333+0000 mon.a (mon.0) 1115 : cluster [DBG] mgrmap e30: y(active, since 1.01276s) 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: audit 2024-09-21T05:18:06.365171+0000 mgr.y (mgr.25016) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:18:07.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:06 smithi110 bash[22020]: cluster 2024-09-21T05:18:06.368947+0000 mgr.y (mgr.25016) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: debug 2024-09-21T05:18:07.394+0000 7ff9a895d640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:18:07] ENGINE Error in HTTPServer.serve 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: Traceback (most recent call last): 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: self._connections.run(self.expiration_interval) 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: self._run(expiration_interval) 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:18:07.795 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: s = self.context.wrap_socket( 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: return self.sslsocket_class._create( 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: self.do_handshake() 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: self._sslobj.do_handshake() 2024-09-21T05:18:07.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:07 smithi089 bash[68019]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cephadm 2024-09-21T05:18:07.169187+0000 mgr.y (mgr.25016) 3 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTING 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cephadm 2024-09-21T05:18:07.272307+0000 mgr.y (mgr.25016) 4 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cluster 2024-09-21T05:18:07.341875+0000 mgr.y (mgr.25016) 5 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cephadm 2024-09-21T05:18:07.396907+0000 mgr.y (mgr.25016) 6 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cephadm 2024-09-21T05:18:07.397119+0000 mgr.y (mgr.25016) 7 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTED 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: cephadm 2024-09-21T05:18:07.398986+0000 mgr.y (mgr.25016) 8 : cephadm [ERR] [21/Sep/2024:05:18:07] ENGINE Error in HTTPServer.serve 2024-09-21T05:18:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: self.do_handshake() 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T05:18:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cephadm 2024-09-21T05:18:07.169187+0000 mgr.y (mgr.25016) 3 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTING 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cephadm 2024-09-21T05:18:07.272307+0000 mgr.y (mgr.25016) 4 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cluster 2024-09-21T05:18:07.341875+0000 mgr.y (mgr.25016) 5 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cephadm 2024-09-21T05:18:07.396907+0000 mgr.y (mgr.25016) 6 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cephadm 2024-09-21T05:18:07.397119+0000 mgr.y (mgr.25016) 7 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTED 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: cephadm 2024-09-21T05:18:07.398986+0000 mgr.y (mgr.25016) 8 : cephadm [ERR] [21/Sep/2024:05:18:07] ENGINE Error in HTTPServer.serve 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: Traceback (most recent call last): 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: self._connections.run(self.expiration_interval) 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: self._run(expiration_interval) 2024-09-21T05:18:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: s = self.context.wrap_socket( 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: return self.sslsocket_class._create( 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: self.do_handshake() 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: self._sslobj.do_handshake() 2024-09-21T05:18:08.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:08 smithi089 bash[26514]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cephadm 2024-09-21T05:18:07.169187+0000 mgr.y (mgr.25016) 3 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTING 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cephadm 2024-09-21T05:18:07.272307+0000 mgr.y (mgr.25016) 4 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cluster 2024-09-21T05:18:07.341875+0000 mgr.y (mgr.25016) 5 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cephadm 2024-09-21T05:18:07.396907+0000 mgr.y (mgr.25016) 6 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cephadm 2024-09-21T05:18:07.397119+0000 mgr.y (mgr.25016) 7 : cephadm [INF] [21/Sep/2024:05:18:07] ENGINE Bus STARTED 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: cephadm 2024-09-21T05:18:07.398986+0000 mgr.y (mgr.25016) 8 : cephadm [ERR] [21/Sep/2024:05:18:07] ENGINE Error in HTTPServer.serve 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: Traceback (most recent call last): 2024-09-21T05:18:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: self._connections.run(self.expiration_interval) 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: self._run(expiration_interval) 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: s = self.context.wrap_socket( 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: return self.sslsocket_class._create( 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: self.do_handshake() 2024-09-21T05:18:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:18:08.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: self._sslobj.do_handshake() 2024-09-21T05:18:08.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:08 smithi110 bash[22020]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:18:09.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:09 smithi089 bash[19831]: audit 2024-09-21T05:18:07.926013+0000 mgr.y (mgr.25016) 9 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:09.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:09 smithi089 bash[19831]: cluster 2024-09-21T05:18:08.355634+0000 mon.a (mon.0) 1116 : cluster [DBG] mgrmap e31: y(active, since 3s) 2024-09-21T05:18:09.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:09 smithi089 bash[26514]: audit 2024-09-21T05:18:07.926013+0000 mgr.y (mgr.25016) 9 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:09.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:09 smithi089 bash[26514]: cluster 2024-09-21T05:18:08.355634+0000 mon.a (mon.0) 1116 : cluster [DBG] mgrmap e31: y(active, since 3s) 2024-09-21T05:18:09.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:09 smithi110 bash[22020]: audit 2024-09-21T05:18:07.926013+0000 mgr.y (mgr.25016) 9 : audit [DBG] from='client.24944 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:09 smithi110 bash[22020]: cluster 2024-09-21T05:18:08.355634+0000 mon.a (mon.0) 1116 : cluster [DBG] mgrmap e31: y(active, since 3s) 2024-09-21T05:18:10.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:10 smithi089 bash[19831]: cluster 2024-09-21T05:18:09.342673+0000 mgr.y (mgr.25016) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:10.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:10 smithi089 bash[26514]: cluster 2024-09-21T05:18:09.342673+0000 mgr.y (mgr.25016) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:10 smithi110 bash[22020]: cluster 2024-09-21T05:18:09.342673+0000 mgr.y (mgr.25016) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:10.869 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:18:11.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: [21/Sep/2024:05:18:11] ENGINE Bus STARTING 2024-09-21T05:18:11.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: CherryPy Checker: 2024-09-21T05:18:11.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: The Application mounted at '' has an empty config. 2024-09-21T05:18:11.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: [21/Sep/2024:05:18:11] ENGINE Serving on http://:::9283 2024-09-21T05:18:11.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: [21/Sep/2024:05:18:11] ENGINE Bus STARTED 2024-09-21T05:18:12.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-21T05:18:12.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: cluster 2024-09-21T05:18:11.343180+0000 mgr.y (mgr.25016) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: cluster 2024-09-21T05:18:11.444341+0000 mon.a (mon.0) 1117 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.446603+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.447137+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.449908+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.450387+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.666628+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[26514]: audit 2024-09-21T05:18:11.670888+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: cluster 2024-09-21T05:18:11.343180+0000 mgr.y (mgr.25016) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:12.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: cluster 2024-09-21T05:18:11.444341+0000 mon.a (mon.0) 1117 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.446603+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.447137+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.449908+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.450387+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.666628+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:12 smithi089 bash[19831]: audit 2024-09-21T05:18:11.670888+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: cluster 2024-09-21T05:18:11.343180+0000 mgr.y (mgr.25016) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: cluster 2024-09-21T05:18:11.444341+0000 mon.a (mon.0) 1117 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.446603+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.447137+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.449908+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.450387+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:18:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.666628+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:12.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:12 smithi110 bash[22020]: audit 2024-09-21T05:18:11.670888+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: cluster 2024-09-21T05:18:12.388508+0000 mon.a (mon.0) 1120 : cluster [DBG] mgrmap e32: y(active, since 7s), standbys: x 2024-09-21T05:18:13.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: audit 2024-09-21T05:18:12.395089+0000 mon.a (mon.0) 1121 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: audit 2024-09-21T05:18:12.414384+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: audit 2024-09-21T05:18:12.425026+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: audit 2024-09-21T05:18:12.773456+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[19831]: audit 2024-09-21T05:18:12.781435+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: cluster 2024-09-21T05:18:12.388508+0000 mon.a (mon.0) 1120 : cluster [DBG] mgrmap e32: y(active, since 7s), standbys: x 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: audit 2024-09-21T05:18:12.395089+0000 mon.a (mon.0) 1121 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: audit 2024-09-21T05:18:12.414384+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: audit 2024-09-21T05:18:12.425026+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: audit 2024-09-21T05:18:12.773456+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:13 smithi089 bash[26514]: audit 2024-09-21T05:18:12.781435+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: cluster 2024-09-21T05:18:12.388508+0000 mon.a (mon.0) 1120 : cluster [DBG] mgrmap e32: y(active, since 7s), standbys: x 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: audit 2024-09-21T05:18:12.395089+0000 mon.a (mon.0) 1121 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: audit 2024-09-21T05:18:12.414384+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: audit 2024-09-21T05:18:12.425026+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: audit 2024-09-21T05:18:12.773456+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:13.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:13 smithi110 bash[22020]: audit 2024-09-21T05:18:12.781435+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: cluster 2024-09-21T05:18:13.344645+0000 mgr.y (mgr.25016) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:13.602488+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:13.615012+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:13.619422+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:13.620727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.014685+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.020625+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.028201+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.036050+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.044577+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.071426+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:18:14.649 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[26514]: audit 2024-09-21T05:18:14.088084+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: cluster 2024-09-21T05:18:13.344645+0000 mgr.y (mgr.25016) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:13.602488+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:13.615012+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:13.619422+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:13.620727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.014685+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.020625+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.028201+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.036050+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.044577+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.650 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.071426+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:18:14.651 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:14 smithi089 bash[19831]: audit 2024-09-21T05:18:14.088084+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: cluster 2024-09-21T05:18:13.344645+0000 mgr.y (mgr.25016) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:18:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:13.602488+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:13.615012+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:13.619422+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:13.620727+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.014685+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.020625+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.028201+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.036050+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.044577+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.071426+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:18:14.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:14 smithi110 bash[22020]: audit 2024-09-21T05:18:14.088084+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.623061+0000 mgr.y (mgr.25016) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.623470+0000 mgr.y (mgr.25016) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.744076+0000 mgr.y (mgr.25016) 15 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.744225+0000 mgr.y (mgr.25016) 16 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.834290+0000 mgr.y (mgr.25016) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.834580+0000 mgr.y (mgr.25016) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.920289+0000 mgr.y (mgr.25016) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:13.920489+0000 mgr.y (mgr.25016) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:14.070831+0000 mgr.y (mgr.25016) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:18:15.640 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[19831]: cephadm 2024-09-21T05:18:14.089456+0000 mgr.y (mgr.25016) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.623061+0000 mgr.y (mgr.25016) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.623470+0000 mgr.y (mgr.25016) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.744076+0000 mgr.y (mgr.25016) 15 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.744225+0000 mgr.y (mgr.25016) 16 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.834290+0000 mgr.y (mgr.25016) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.834580+0000 mgr.y (mgr.25016) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.920289+0000 mgr.y (mgr.25016) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:13.920489+0000 mgr.y (mgr.25016) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:14.070831+0000 mgr.y (mgr.25016) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:18:15.641 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:15 smithi089 bash[26514]: cephadm 2024-09-21T05:18:14.089456+0000 mgr.y (mgr.25016) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.623061+0000 mgr.y (mgr.25016) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.623470+0000 mgr.y (mgr.25016) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.744076+0000 mgr.y (mgr.25016) 15 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.744225+0000 mgr.y (mgr.25016) 16 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.834290+0000 mgr.y (mgr.25016) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.834580+0000 mgr.y (mgr.25016) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:18:15.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.920289+0000 mgr.y (mgr.25016) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:13.920489+0000 mgr.y (mgr.25016) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:18:15.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:14.070831+0000 mgr.y (mgr.25016) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:18:15.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:15 smithi110 bash[22020]: cephadm 2024-09-21T05:18:14.089456+0000 mgr.y (mgr.25016) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:18:16.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:16 smithi089 bash[19831]: cluster 2024-09-21T05:18:15.345745+0000 mgr.y (mgr.25016) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:18:16.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:16 smithi089 bash[26514]: cluster 2024-09-21T05:18:15.345745+0000 mgr.y (mgr.25016) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:18:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:16 smithi110 bash[22020]: cluster 2024-09-21T05:18:15.345745+0000 mgr.y (mgr.25016) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:18:18.544 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[19831]: audit 2024-09-21T05:18:17.253645+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[19831]: audit 2024-09-21T05:18:17.259418+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[19831]: cephadm 2024-09-21T05:18:17.261023+0000 mgr.y (mgr.25016) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[19831]: cluster 2024-09-21T05:18:17.346727+0000 mgr.y (mgr.25016) 25 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[19831]: cephadm 2024-09-21T05:18:17.501324+0000 mgr.y (mgr.25016) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[26514]: audit 2024-09-21T05:18:17.253645+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[26514]: audit 2024-09-21T05:18:17.259418+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[26514]: cephadm 2024-09-21T05:18:17.261023+0000 mgr.y (mgr.25016) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[26514]: cluster 2024-09-21T05:18:17.346727+0000 mgr.y (mgr.25016) 25 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:18.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:18 smithi089 bash[26514]: cephadm 2024-09-21T05:18:17.501324+0000 mgr.y (mgr.25016) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:18:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:18 smithi110 bash[22020]: audit 2024-09-21T05:18:17.253645+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:18 smithi110 bash[22020]: audit 2024-09-21T05:18:17.259418+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:18 smithi110 bash[22020]: cephadm 2024-09-21T05:18:17.261023+0000 mgr.y (mgr.25016) 24 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:18:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:18 smithi110 bash[22020]: cluster 2024-09-21T05:18:17.346727+0000 mgr.y (mgr.25016) 25 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:18 smithi110 bash[22020]: cephadm 2024-09-21T05:18:17.501324+0000 mgr.y (mgr.25016) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:18:19.535 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:19 smithi110 bash[22020]: audit 2024-09-21T05:18:18.939831+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.15.89:0/2844526110' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:18:19.544 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:19 smithi089 bash[19831]: audit 2024-09-21T05:18:18.939831+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.15.89:0/2844526110' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:18:19.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:19 smithi089 bash[26514]: audit 2024-09-21T05:18:18.939831+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.15.89:0/2844526110' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:18:20.544 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:20 smithi089 bash[19831]: cluster 2024-09-21T05:18:19.347421+0000 mgr.y (mgr.25016) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:20.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:20 smithi089 bash[26514]: cluster 2024-09-21T05:18:19.347421+0000 mgr.y (mgr.25016) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:20 smithi110 bash[22020]: cluster 2024-09-21T05:18:19.347421+0000 mgr.y (mgr.25016) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:21.489 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:21 smithi110 bash[22020]: audit 2024-09-21T05:18:20.966010+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:21.544 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:21 smithi089 bash[19831]: audit 2024-09-21T05:18:20.966010+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:21.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:21 smithi089 bash[26514]: audit 2024-09-21T05:18:20.966010+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:22.084 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:21 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:18:22.084 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:18:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-21T05:18:22.544 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:22 smithi089 bash[19831]: cluster 2024-09-21T05:18:21.348376+0000 mgr.y (mgr.25016) 28 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:22.545 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:22 smithi089 bash[26514]: cluster 2024-09-21T05:18:21.348376+0000 mgr.y (mgr.25016) 28 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:22.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[22020]: cluster 2024-09-21T05:18:21.348376+0000 mgr.y (mgr.25016) 28 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:18:22.557 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.085Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.086Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.086Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.086Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:18:22.558 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[51860]: ts=2024-09-21T05:18:22.086Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:18:22.884 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[53478]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:18:22.884 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 bash[53538]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:18:22.884 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:18:22.884 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:18:22.884 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:22 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:18:24.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.826738+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.836992+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.843012+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.844583+0000 mgr.y (mgr.25016) 29 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.862163+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: cephadm 2024-09-21T05:18:22.864536+0000 mgr.y (mgr.25016) 30 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.865043+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.866068+0000 mgr.y (mgr.25016) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.868454+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.869729+0000 mgr.y (mgr.25016) 32 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.874707+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.881582+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: audit 2024-09-21T05:18:22.882591+0000 mgr.y (mgr.25016) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:23 smithi110 bash[22020]: cluster 2024-09-21T05:18:23.349943+0000 mgr.y (mgr.25016) 34 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:24.095 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.042Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.042Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.042Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.042Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.042Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.044Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:18:24.096 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.044Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.046Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.046Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.048Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.048Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.824µs 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.048Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:18:24.097 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.049Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.063Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.068Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.069Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.069Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=42.829µs wal_replay_duration=20.198248ms wbl_replay_duration=141ns total_replay_duration=20.267693ms 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.070Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:18:24.098 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.070Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:18:24.099 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.070Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:18:24.099 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.094Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.599423ms db_storage=902ns remote_storage=1.349µs web_handler=396ns query_engine=668ns scrape=261.913µs scrape_sd=160.135µs notify=24.754µs notify_sd=22.214µs rules=22.694545ms tracing=6.823µs 2024-09-21T05:18:24.099 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.094Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:18:24.099 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:18:24 smithi110 bash[53567]: ts=2024-09-21T05:18:24.094Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.826738+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.836992+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.843012+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.844583+0000 mgr.y (mgr.25016) 29 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.862163+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: cephadm 2024-09-21T05:18:22.864536+0000 mgr.y (mgr.25016) 30 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:18:24.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.865043+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.866068+0000 mgr.y (mgr.25016) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.868454+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.869729+0000 mgr.y (mgr.25016) 32 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.874707+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.881582+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: audit 2024-09-21T05:18:22.882591+0000 mgr.y (mgr.25016) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[19831]: cluster 2024-09-21T05:18:23.349943+0000 mgr.y (mgr.25016) 34 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.826738+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.836992+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.843012+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.844583+0000 mgr.y (mgr.25016) 29 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.862163+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: cephadm 2024-09-21T05:18:22.864536+0000 mgr.y (mgr.25016) 30 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.865043+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.866068+0000 mgr.y (mgr.25016) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.868454+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.869729+0000 mgr.y (mgr.25016) 32 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.874707+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.881582+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: audit 2024-09-21T05:18:22.882591+0000 mgr.y (mgr.25016) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:18:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:23 smithi089 bash[26514]: cluster 2024-09-21T05:18:23.349943+0000 mgr.y (mgr.25016) 34 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:18:26.794 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:26 smithi089 bash[19831]: cluster 2024-09-21T05:18:25.350650+0000 mgr.y (mgr.25016) 35 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:26.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:26 smithi089 bash[26514]: cluster 2024-09-21T05:18:25.350650+0000 mgr.y (mgr.25016) 35 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:26 smithi110 bash[22020]: cluster 2024-09-21T05:18:25.350650+0000 mgr.y (mgr.25016) 35 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:28.679 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:28 smithi089 bash[19831]: cluster 2024-09-21T05:18:27.352339+0000 mgr.y (mgr.25016) 36 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:28.680 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:28 smithi089 bash[26514]: cluster 2024-09-21T05:18:27.352339+0000 mgr.y (mgr.25016) 36 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:28 smithi110 bash[22020]: cluster 2024-09-21T05:18:27.352339+0000 mgr.y (mgr.25016) 36 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.681979+0000 mgr.y (mgr.25016) 37 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.837622+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.843943+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.986659+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.996900+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:28.999245+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:30.295 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:29.000758+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: audit 2024-09-21T05:18:29.010458+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[19831]: cluster 2024-09-21T05:18:29.353181+0000 mgr.y (mgr.25016) 38 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.681979+0000 mgr.y (mgr.25016) 37 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.837622+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.843943+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.986659+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.996900+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:28.999245+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:29.000758+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: audit 2024-09-21T05:18:29.010458+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:29 smithi089 bash[26514]: cluster 2024-09-21T05:18:29.353181+0000 mgr.y (mgr.25016) 38 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.681979+0000 mgr.y (mgr.25016) 37 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.837622+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.843943+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.986659+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.996900+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:28.999245+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:29.000758+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: audit 2024-09-21T05:18:29.010458+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:18:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:29 smithi110 bash[22020]: cluster 2024-09-21T05:18:29.353181+0000 mgr.y (mgr.25016) 38 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:32.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:31 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:31] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:18:32.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:32 smithi089 bash[19831]: cluster 2024-09-21T05:18:31.354189+0000 mgr.y (mgr.25016) 39 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:32.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:32 smithi089 bash[26514]: cluster 2024-09-21T05:18:31.354189+0000 mgr.y (mgr.25016) 39 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:32 smithi110 bash[22020]: cluster 2024-09-21T05:18:31.354189+0000 mgr.y (mgr.25016) 39 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:18:34.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:34 smithi089 bash[19831]: cluster 2024-09-21T05:18:33.355661+0000 mgr.y (mgr.25016) 40 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:34.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:34 smithi089 bash[26514]: cluster 2024-09-21T05:18:33.355661+0000 mgr.y (mgr.25016) 40 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:34.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:34 smithi110 bash[22020]: cluster 2024-09-21T05:18:33.355661+0000 mgr.y (mgr.25016) 40 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:36.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:36 smithi089 bash[19831]: cluster 2024-09-21T05:18:35.356404+0000 mgr.y (mgr.25016) 41 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:36.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:36 smithi089 bash[19831]: audit 2024-09-21T05:18:35.966454+0000 mon.a (mon.0) 1156 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:36.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:36 smithi089 bash[26514]: cluster 2024-09-21T05:18:35.356404+0000 mgr.y (mgr.25016) 41 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:36.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:36 smithi089 bash[26514]: audit 2024-09-21T05:18:35.966454+0000 mon.a (mon.0) 1156 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:36 smithi110 bash[22020]: cluster 2024-09-21T05:18:35.356404+0000 mgr.y (mgr.25016) 41 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:36 smithi110 bash[22020]: audit 2024-09-21T05:18:35.966454+0000 mon.a (mon.0) 1156 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:38.773 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:38 smithi089 bash[19831]: cluster 2024-09-21T05:18:37.358096+0000 mgr.y (mgr.25016) 42 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:38.774 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:38 smithi089 bash[26514]: cluster 2024-09-21T05:18:37.358096+0000 mgr.y (mgr.25016) 42 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:38 smithi110 bash[22020]: cluster 2024-09-21T05:18:37.358096+0000 mgr.y (mgr.25016) 42 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:40.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:40 smithi089 bash[19831]: audit 2024-09-21T05:18:38.688279+0000 mgr.y (mgr.25016) 43 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:40.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:40 smithi089 bash[19831]: cluster 2024-09-21T05:18:39.358776+0000 mgr.y (mgr.25016) 44 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:40.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:40 smithi089 bash[26514]: audit 2024-09-21T05:18:38.688279+0000 mgr.y (mgr.25016) 43 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:40.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:40 smithi089 bash[26514]: cluster 2024-09-21T05:18:39.358776+0000 mgr.y (mgr.25016) 44 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:40 smithi110 bash[22020]: audit 2024-09-21T05:18:38.688279+0000 mgr.y (mgr.25016) 43 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:40 smithi110 bash[22020]: cluster 2024-09-21T05:18:39.358776+0000 mgr.y (mgr.25016) 44 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:42.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:41 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:41] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:18:42.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:42 smithi089 bash[19831]: cluster 2024-09-21T05:18:41.359709+0000 mgr.y (mgr.25016) 45 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:42.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:42 smithi089 bash[26514]: cluster 2024-09-21T05:18:41.359709+0000 mgr.y (mgr.25016) 45 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:42 smithi110 bash[22020]: cluster 2024-09-21T05:18:41.359709+0000 mgr.y (mgr.25016) 45 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:44.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:44 smithi089 bash[19831]: cluster 2024-09-21T05:18:43.361193+0000 mgr.y (mgr.25016) 46 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:44.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:44 smithi089 bash[26514]: cluster 2024-09-21T05:18:43.361193+0000 mgr.y (mgr.25016) 46 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:44 smithi110 bash[22020]: cluster 2024-09-21T05:18:43.361193+0000 mgr.y (mgr.25016) 46 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:46.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:46 smithi089 bash[19831]: cluster 2024-09-21T05:18:45.361969+0000 mgr.y (mgr.25016) 47 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:46.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:46 smithi089 bash[26514]: cluster 2024-09-21T05:18:45.361969+0000 mgr.y (mgr.25016) 47 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:46 smithi110 bash[22020]: cluster 2024-09-21T05:18:45.361969+0000 mgr.y (mgr.25016) 47 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:48.698 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:48 smithi089 bash[19831]: cluster 2024-09-21T05:18:47.363634+0000 mgr.y (mgr.25016) 48 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:48.698 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:48 smithi089 bash[26514]: cluster 2024-09-21T05:18:47.363634+0000 mgr.y (mgr.25016) 48 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:48 smithi110 bash[22020]: cluster 2024-09-21T05:18:47.363634+0000 mgr.y (mgr.25016) 48 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:50.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:50 smithi089 bash[19831]: audit 2024-09-21T05:18:48.699450+0000 mgr.y (mgr.25016) 49 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:50.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:50 smithi089 bash[19831]: cluster 2024-09-21T05:18:49.364305+0000 mgr.y (mgr.25016) 50 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:50.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:50 smithi089 bash[26514]: audit 2024-09-21T05:18:48.699450+0000 mgr.y (mgr.25016) 49 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:50.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:50 smithi089 bash[26514]: cluster 2024-09-21T05:18:49.364305+0000 mgr.y (mgr.25016) 50 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:50 smithi110 bash[22020]: audit 2024-09-21T05:18:48.699450+0000 mgr.y (mgr.25016) 49 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:18:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:50 smithi110 bash[22020]: cluster 2024-09-21T05:18:49.364305+0000 mgr.y (mgr.25016) 50 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:51 smithi089 bash[19831]: audit 2024-09-21T05:18:50.967309+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:51.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:51 smithi089 bash[26514]: audit 2024-09-21T05:18:50.967309+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:51.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:51 smithi110 bash[22020]: audit 2024-09-21T05:18:50.967309+0000 mon.a (mon.0) 1157 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:18:52.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:18:51 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:18:51] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:18:52.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:52 smithi089 bash[19831]: cluster 2024-09-21T05:18:51.365220+0000 mgr.y (mgr.25016) 51 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:52.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:52 smithi089 bash[26514]: cluster 2024-09-21T05:18:51.365220+0000 mgr.y (mgr.25016) 51 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:52 smithi110 bash[22020]: cluster 2024-09-21T05:18:51.365220+0000 mgr.y (mgr.25016) 51 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:54.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:54 smithi089 bash[19831]: cluster 2024-09-21T05:18:53.366740+0000 mgr.y (mgr.25016) 52 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:54.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:54 smithi089 bash[26514]: cluster 2024-09-21T05:18:53.366740+0000 mgr.y (mgr.25016) 52 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:54 smithi110 bash[22020]: cluster 2024-09-21T05:18:53.366740+0000 mgr.y (mgr.25016) 52 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:56.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:56 smithi089 bash[19831]: cluster 2024-09-21T05:18:55.367464+0000 mgr.y (mgr.25016) 53 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:56.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:56 smithi089 bash[26514]: cluster 2024-09-21T05:18:55.367464+0000 mgr.y (mgr.25016) 53 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:56 smithi110 bash[22020]: cluster 2024-09-21T05:18:55.367464+0000 mgr.y (mgr.25016) 53 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:18:58.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:18:58 smithi089 bash[19831]: cluster 2024-09-21T05:18:57.369151+0000 mgr.y (mgr.25016) 54 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:58.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:18:58 smithi089 bash[26514]: cluster 2024-09-21T05:18:57.369151+0000 mgr.y (mgr.25016) 54 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:18:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:18:58 smithi110 bash[22020]: cluster 2024-09-21T05:18:57.369151+0000 mgr.y (mgr.25016) 54 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:00 smithi089 bash[19831]: audit 2024-09-21T05:18:58.703165+0000 mgr.y (mgr.25016) 55 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:00.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:00 smithi089 bash[19831]: cluster 2024-09-21T05:18:59.369892+0000 mgr.y (mgr.25016) 56 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:00 smithi089 bash[26514]: audit 2024-09-21T05:18:58.703165+0000 mgr.y (mgr.25016) 55 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:00 smithi089 bash[26514]: cluster 2024-09-21T05:18:59.369892+0000 mgr.y (mgr.25016) 56 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:00 smithi110 bash[22020]: audit 2024-09-21T05:18:58.703165+0000 mgr.y (mgr.25016) 55 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:00 smithi110 bash[22020]: cluster 2024-09-21T05:18:59.369892+0000 mgr.y (mgr.25016) 56 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:02.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:01 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:01] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:19:02.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:02 smithi089 bash[19831]: cluster 2024-09-21T05:19:01.370865+0000 mgr.y (mgr.25016) 57 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:02.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:02 smithi089 bash[26514]: cluster 2024-09-21T05:19:01.370865+0000 mgr.y (mgr.25016) 57 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:02 smithi110 bash[22020]: cluster 2024-09-21T05:19:01.370865+0000 mgr.y (mgr.25016) 57 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:04.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:04 smithi089 bash[19831]: cluster 2024-09-21T05:19:03.372425+0000 mgr.y (mgr.25016) 58 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:04.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:04 smithi089 bash[26514]: cluster 2024-09-21T05:19:03.372425+0000 mgr.y (mgr.25016) 58 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:04 smithi110 bash[22020]: cluster 2024-09-21T05:19:03.372425+0000 mgr.y (mgr.25016) 58 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:06.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:06 smithi089 bash[19831]: cluster 2024-09-21T05:19:05.373167+0000 mgr.y (mgr.25016) 59 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:06.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:06 smithi089 bash[19831]: audit 2024-09-21T05:19:05.967230+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:06.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:06 smithi089 bash[26514]: cluster 2024-09-21T05:19:05.373167+0000 mgr.y (mgr.25016) 59 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:06.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:06 smithi089 bash[26514]: audit 2024-09-21T05:19:05.967230+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:06 smithi110 bash[22020]: cluster 2024-09-21T05:19:05.373167+0000 mgr.y (mgr.25016) 59 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:06 smithi110 bash[22020]: audit 2024-09-21T05:19:05.967230+0000 mon.a (mon.0) 1158 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:08.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:08 smithi089 bash[19831]: cluster 2024-09-21T05:19:07.375000+0000 mgr.y (mgr.25016) 60 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:08.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:08 smithi089 bash[26514]: cluster 2024-09-21T05:19:07.375000+0000 mgr.y (mgr.25016) 60 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:08 smithi110 bash[22020]: cluster 2024-09-21T05:19:07.375000+0000 mgr.y (mgr.25016) 60 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:10.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:10 smithi089 bash[19831]: audit 2024-09-21T05:19:08.714484+0000 mgr.y (mgr.25016) 61 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:10.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:10 smithi089 bash[19831]: cluster 2024-09-21T05:19:09.375744+0000 mgr.y (mgr.25016) 62 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:10.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:10 smithi089 bash[26514]: audit 2024-09-21T05:19:08.714484+0000 mgr.y (mgr.25016) 61 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:10.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:10 smithi089 bash[26514]: cluster 2024-09-21T05:19:09.375744+0000 mgr.y (mgr.25016) 62 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:10 smithi110 bash[22020]: audit 2024-09-21T05:19:08.714484+0000 mgr.y (mgr.25016) 61 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:10 smithi110 bash[22020]: cluster 2024-09-21T05:19:09.375744+0000 mgr.y (mgr.25016) 62 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:12.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:11 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:11] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.43.0" 2024-09-21T05:19:12.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:12 smithi089 bash[19831]: cluster 2024-09-21T05:19:11.377053+0000 mgr.y (mgr.25016) 63 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:12.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:12 smithi089 bash[26514]: cluster 2024-09-21T05:19:11.377053+0000 mgr.y (mgr.25016) 63 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:12 smithi110 bash[22020]: cluster 2024-09-21T05:19:11.377053+0000 mgr.y (mgr.25016) 63 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:14.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:14 smithi089 bash[19831]: cluster 2024-09-21T05:19:13.378572+0000 mgr.y (mgr.25016) 64 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:14.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:14 smithi089 bash[26514]: cluster 2024-09-21T05:19:13.378572+0000 mgr.y (mgr.25016) 64 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:14 smithi110 bash[22020]: cluster 2024-09-21T05:19:13.378572+0000 mgr.y (mgr.25016) 64 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:16.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:16 smithi089 bash[19831]: cluster 2024-09-21T05:19:15.379423+0000 mgr.y (mgr.25016) 65 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:16.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:16 smithi089 bash[26514]: cluster 2024-09-21T05:19:15.379423+0000 mgr.y (mgr.25016) 65 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:16 smithi110 bash[22020]: cluster 2024-09-21T05:19:15.379423+0000 mgr.y (mgr.25016) 65 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:18.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:18 smithi089 bash[19831]: cluster 2024-09-21T05:19:17.381128+0000 mgr.y (mgr.25016) 66 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:18.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:18 smithi089 bash[26514]: cluster 2024-09-21T05:19:17.381128+0000 mgr.y (mgr.25016) 66 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:18 smithi110 bash[22020]: cluster 2024-09-21T05:19:17.381128+0000 mgr.y (mgr.25016) 66 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:20.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:20 smithi089 bash[19831]: audit 2024-09-21T05:19:18.722176+0000 mgr.y (mgr.25016) 67 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:20.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:20 smithi089 bash[19831]: cluster 2024-09-21T05:19:19.381916+0000 mgr.y (mgr.25016) 68 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:20.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:20 smithi089 bash[26514]: audit 2024-09-21T05:19:18.722176+0000 mgr.y (mgr.25016) 67 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:20.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:20 smithi089 bash[26514]: cluster 2024-09-21T05:19:19.381916+0000 mgr.y (mgr.25016) 68 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:20 smithi110 bash[22020]: audit 2024-09-21T05:19:18.722176+0000 mgr.y (mgr.25016) 67 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:20 smithi110 bash[22020]: cluster 2024-09-21T05:19:19.381916+0000 mgr.y (mgr.25016) 68 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:21.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:21 smithi089 bash[19831]: audit 2024-09-21T05:19:20.968172+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:21.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:21 smithi089 bash[26514]: audit 2024-09-21T05:19:20.968172+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:21 smithi110 bash[22020]: audit 2024-09-21T05:19:20.968172+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:22.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:21 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:21] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.43.0" 2024-09-21T05:19:22.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:22 smithi089 bash[19831]: cluster 2024-09-21T05:19:21.383421+0000 mgr.y (mgr.25016) 69 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:22.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:22 smithi089 bash[26514]: cluster 2024-09-21T05:19:21.383421+0000 mgr.y (mgr.25016) 69 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:22 smithi110 bash[22020]: cluster 2024-09-21T05:19:21.383421+0000 mgr.y (mgr.25016) 69 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:24.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:24 smithi089 bash[19831]: cluster 2024-09-21T05:19:23.384427+0000 mgr.y (mgr.25016) 70 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:24.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:24 smithi089 bash[26514]: cluster 2024-09-21T05:19:23.384427+0000 mgr.y (mgr.25016) 70 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:24 smithi110 bash[22020]: cluster 2024-09-21T05:19:23.384427+0000 mgr.y (mgr.25016) 70 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:26.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:26 smithi089 bash[19831]: cluster 2024-09-21T05:19:25.385119+0000 mgr.y (mgr.25016) 71 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:26.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:26 smithi089 bash[26514]: cluster 2024-09-21T05:19:25.385119+0000 mgr.y (mgr.25016) 71 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:26 smithi110 bash[22020]: cluster 2024-09-21T05:19:25.385119+0000 mgr.y (mgr.25016) 71 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:28 smithi110 bash[22020]: cluster 2024-09-21T05:19:27.386790+0000 mgr.y (mgr.25016) 72 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:29.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:28 smithi089 bash[19831]: cluster 2024-09-21T05:19:27.386790+0000 mgr.y (mgr.25016) 72 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:29.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:28 smithi089 bash[26514]: cluster 2024-09-21T05:19:27.386790+0000 mgr.y (mgr.25016) 72 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:30 smithi110 bash[22020]: audit 2024-09-21T05:19:28.730186+0000 mgr.y (mgr.25016) 73 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:30 smithi110 bash[22020]: cluster 2024-09-21T05:19:29.387476+0000 mgr.y (mgr.25016) 74 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:30 smithi110 bash[22020]: audit 2024-09-21T05:19:29.840530+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:30 smithi110 bash[22020]: audit 2024-09-21T05:19:29.842035+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:30 smithi110 bash[22020]: audit 2024-09-21T05:19:29.851590+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:19:31.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[19831]: audit 2024-09-21T05:19:28.730186+0000 mgr.y (mgr.25016) 73 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:31.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[19831]: cluster 2024-09-21T05:19:29.387476+0000 mgr.y (mgr.25016) 74 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[19831]: audit 2024-09-21T05:19:29.840530+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[19831]: audit 2024-09-21T05:19:29.842035+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[19831]: audit 2024-09-21T05:19:29.851590+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[26514]: audit 2024-09-21T05:19:28.730186+0000 mgr.y (mgr.25016) 73 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[26514]: cluster 2024-09-21T05:19:29.387476+0000 mgr.y (mgr.25016) 74 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[26514]: audit 2024-09-21T05:19:29.840530+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[26514]: audit 2024-09-21T05:19:29.842035+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:19:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:30 smithi089 bash[26514]: audit 2024-09-21T05:19:29.851590+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:19:32.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:31 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:31] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.43.0" 2024-09-21T05:19:33.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:32 smithi089 bash[19831]: cluster 2024-09-21T05:19:31.389043+0000 mgr.y (mgr.25016) 75 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:33.045 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:32 smithi089 bash[26514]: cluster 2024-09-21T05:19:31.389043+0000 mgr.y (mgr.25016) 75 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:32 smithi110 bash[22020]: cluster 2024-09-21T05:19:31.389043+0000 mgr.y (mgr.25016) 75 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:34.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:33 smithi089 bash[19831]: cluster 2024-09-21T05:19:33.389778+0000 mgr.y (mgr.25016) 76 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:34.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:33 smithi089 bash[26514]: cluster 2024-09-21T05:19:33.389778+0000 mgr.y (mgr.25016) 76 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:33 smithi110 bash[22020]: cluster 2024-09-21T05:19:33.389778+0000 mgr.y (mgr.25016) 76 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:36.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:36 smithi089 bash[19831]: cluster 2024-09-21T05:19:35.390474+0000 mgr.y (mgr.25016) 77 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:36 smithi089 bash[19831]: audit 2024-09-21T05:19:35.968271+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:36 smithi089 bash[26514]: cluster 2024-09-21T05:19:35.390474+0000 mgr.y (mgr.25016) 77 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:36 smithi089 bash[26514]: audit 2024-09-21T05:19:35.968271+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:36 smithi110 bash[22020]: cluster 2024-09-21T05:19:35.390474+0000 mgr.y (mgr.25016) 77 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:36 smithi110 bash[22020]: audit 2024-09-21T05:19:35.968271+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:38.740 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:38 smithi089 bash[19831]: cluster 2024-09-21T05:19:37.392114+0000 mgr.y (mgr.25016) 78 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:38.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:38 smithi089 bash[26514]: cluster 2024-09-21T05:19:37.392114+0000 mgr.y (mgr.25016) 78 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:38 smithi110 bash[22020]: cluster 2024-09-21T05:19:37.392114+0000 mgr.y (mgr.25016) 78 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:40.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:40 smithi089 bash[19831]: audit 2024-09-21T05:19:38.741406+0000 mgr.y (mgr.25016) 79 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:40 smithi089 bash[19831]: cluster 2024-09-21T05:19:39.392823+0000 mgr.y (mgr.25016) 80 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:40 smithi089 bash[26514]: audit 2024-09-21T05:19:38.741406+0000 mgr.y (mgr.25016) 79 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:40 smithi089 bash[26514]: cluster 2024-09-21T05:19:39.392823+0000 mgr.y (mgr.25016) 80 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:40 smithi110 bash[22020]: audit 2024-09-21T05:19:38.741406+0000 mgr.y (mgr.25016) 79 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:40 smithi110 bash[22020]: cluster 2024-09-21T05:19:39.392823+0000 mgr.y (mgr.25016) 80 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:42.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:41 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:41] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:19:42.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:42 smithi089 bash[19831]: cluster 2024-09-21T05:19:41.394430+0000 mgr.y (mgr.25016) 81 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:42 smithi089 bash[26514]: cluster 2024-09-21T05:19:41.394430+0000 mgr.y (mgr.25016) 81 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:42 smithi110 bash[22020]: cluster 2024-09-21T05:19:41.394430+0000 mgr.y (mgr.25016) 81 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:44.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:44 smithi089 bash[19831]: cluster 2024-09-21T05:19:43.395146+0000 mgr.y (mgr.25016) 82 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:44.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:44 smithi089 bash[26514]: cluster 2024-09-21T05:19:43.395146+0000 mgr.y (mgr.25016) 82 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:44 smithi110 bash[22020]: cluster 2024-09-21T05:19:43.395146+0000 mgr.y (mgr.25016) 82 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:46.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:46 smithi089 bash[26514]: cluster 2024-09-21T05:19:45.395831+0000 mgr.y (mgr.25016) 83 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:46 smithi089 bash[19831]: cluster 2024-09-21T05:19:45.395831+0000 mgr.y (mgr.25016) 83 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:46 smithi110 bash[22020]: cluster 2024-09-21T05:19:45.395831+0000 mgr.y (mgr.25016) 83 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:48.752 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:48 smithi089 bash[26514]: cluster 2024-09-21T05:19:47.397453+0000 mgr.y (mgr.25016) 84 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:48.752 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:48 smithi089 bash[19831]: cluster 2024-09-21T05:19:47.397453+0000 mgr.y (mgr.25016) 84 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:48 smithi110 bash[22020]: cluster 2024-09-21T05:19:47.397453+0000 mgr.y (mgr.25016) 84 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:50.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:50 smithi089 bash[19831]: audit 2024-09-21T05:19:48.752660+0000 mgr.y (mgr.25016) 85 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:50 smithi089 bash[19831]: cluster 2024-09-21T05:19:49.398154+0000 mgr.y (mgr.25016) 86 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:50 smithi089 bash[26514]: audit 2024-09-21T05:19:48.752660+0000 mgr.y (mgr.25016) 85 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:50 smithi089 bash[26514]: cluster 2024-09-21T05:19:49.398154+0000 mgr.y (mgr.25016) 86 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:50 smithi110 bash[22020]: audit 2024-09-21T05:19:48.752660+0000 mgr.y (mgr.25016) 85 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:19:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:50 smithi110 bash[22020]: cluster 2024-09-21T05:19:49.398154+0000 mgr.y (mgr.25016) 86 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:51.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:51 smithi089 bash[19831]: audit 2024-09-21T05:19:50.968552+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:51.839 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:51 smithi089 bash[26514]: audit 2024-09-21T05:19:50.968552+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:51.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:51 smithi110 bash[22020]: audit 2024-09-21T05:19:50.968552+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:19:52.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:19:51 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:19:51] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:19:52.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:52 smithi089 bash[19831]: cluster 2024-09-21T05:19:51.399710+0000 mgr.y (mgr.25016) 87 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:52.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:52 smithi089 bash[26514]: cluster 2024-09-21T05:19:51.399710+0000 mgr.y (mgr.25016) 87 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:52 smithi110 bash[22020]: cluster 2024-09-21T05:19:51.399710+0000 mgr.y (mgr.25016) 87 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:54.795 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:54 smithi089 bash[26514]: cluster 2024-09-21T05:19:53.400389+0000 mgr.y (mgr.25016) 88 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:54 smithi089 bash[19831]: cluster 2024-09-21T05:19:53.400389+0000 mgr.y (mgr.25016) 88 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:54 smithi110 bash[22020]: cluster 2024-09-21T05:19:53.400389+0000 mgr.y (mgr.25016) 88 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:56 smithi089 bash[26514]: cluster 2024-09-21T05:19:55.401081+0000 mgr.y (mgr.25016) 89 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:56 smithi089 bash[19831]: cluster 2024-09-21T05:19:55.401081+0000 mgr.y (mgr.25016) 89 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:56 smithi110 bash[22020]: cluster 2024-09-21T05:19:55.401081+0000 mgr.y (mgr.25016) 89 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:19:58.763 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:19:58 smithi089 bash[19831]: cluster 2024-09-21T05:19:57.402763+0000 mgr.y (mgr.25016) 90 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:58.763 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:19:58 smithi089 bash[26514]: cluster 2024-09-21T05:19:57.402763+0000 mgr.y (mgr.25016) 90 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:19:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:19:58 smithi110 bash[22020]: cluster 2024-09-21T05:19:57.402763+0000 mgr.y (mgr.25016) 90 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[19831]: audit 2024-09-21T05:19:58.763879+0000 mgr.y (mgr.25016) 91 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[19831]: cluster 2024-09-21T05:19:59.403520+0000 mgr.y (mgr.25016) 92 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[19831]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 1165 : cluster [INF] overall HEALTH_OK 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[26514]: audit 2024-09-21T05:19:58.763879+0000 mgr.y (mgr.25016) 91 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[26514]: cluster 2024-09-21T05:19:59.403520+0000 mgr.y (mgr.25016) 92 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:00 smithi089 bash[26514]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 1165 : cluster [INF] overall HEALTH_OK 2024-09-21T05:20:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:00 smithi110 bash[22020]: audit 2024-09-21T05:19:58.763879+0000 mgr.y (mgr.25016) 91 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:00 smithi110 bash[22020]: cluster 2024-09-21T05:19:59.403520+0000 mgr.y (mgr.25016) 92 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:00 smithi110 bash[22020]: cluster 2024-09-21T05:20:00.000152+0000 mon.a (mon.0) 1165 : cluster [INF] overall HEALTH_OK 2024-09-21T05:20:02.295 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:01 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:01] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:20:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:02 smithi089 bash[19831]: cluster 2024-09-21T05:20:01.405113+0000 mgr.y (mgr.25016) 93 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:02.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:02 smithi089 bash[26514]: cluster 2024-09-21T05:20:01.405113+0000 mgr.y (mgr.25016) 93 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:02 smithi110 bash[22020]: cluster 2024-09-21T05:20:01.405113+0000 mgr.y (mgr.25016) 93 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:04.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:04 smithi089 bash[19831]: cluster 2024-09-21T05:20:03.405825+0000 mgr.y (mgr.25016) 94 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:04.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:04 smithi089 bash[26514]: cluster 2024-09-21T05:20:03.405825+0000 mgr.y (mgr.25016) 94 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:04 smithi110 bash[22020]: cluster 2024-09-21T05:20:03.405825+0000 mgr.y (mgr.25016) 94 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:06.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:06 smithi089 bash[19831]: cluster 2024-09-21T05:20:05.406498+0000 mgr.y (mgr.25016) 95 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:06.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:06 smithi089 bash[19831]: audit 2024-09-21T05:20:05.968882+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:06.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:06 smithi089 bash[26514]: cluster 2024-09-21T05:20:05.406498+0000 mgr.y (mgr.25016) 95 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:06.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:06 smithi089 bash[26514]: audit 2024-09-21T05:20:05.968882+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:06 smithi110 bash[22020]: cluster 2024-09-21T05:20:05.406498+0000 mgr.y (mgr.25016) 95 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:06 smithi110 bash[22020]: audit 2024-09-21T05:20:05.968882+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:08.774 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:08 smithi089 bash[19831]: cluster 2024-09-21T05:20:07.408120+0000 mgr.y (mgr.25016) 96 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:08.775 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:08 smithi089 bash[26514]: cluster 2024-09-21T05:20:07.408120+0000 mgr.y (mgr.25016) 96 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:08 smithi110 bash[22020]: cluster 2024-09-21T05:20:07.408120+0000 mgr.y (mgr.25016) 96 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:10 smithi089 bash[19831]: audit 2024-09-21T05:20:08.775177+0000 mgr.y (mgr.25016) 97 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:10 smithi089 bash[19831]: cluster 2024-09-21T05:20:09.408823+0000 mgr.y (mgr.25016) 98 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:10.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:10 smithi089 bash[26514]: audit 2024-09-21T05:20:08.775177+0000 mgr.y (mgr.25016) 97 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:10.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:10 smithi089 bash[26514]: cluster 2024-09-21T05:20:09.408823+0000 mgr.y (mgr.25016) 98 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:10 smithi110 bash[22020]: audit 2024-09-21T05:20:08.775177+0000 mgr.y (mgr.25016) 97 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:10 smithi110 bash[22020]: cluster 2024-09-21T05:20:09.408823+0000 mgr.y (mgr.25016) 98 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:12.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:11 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:11] "GET /metrics HTTP/1.1" 200 38228 "" "Prometheus/2.43.0" 2024-09-21T05:20:12.795 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:12 smithi089 bash[19831]: cluster 2024-09-21T05:20:11.410446+0000 mgr.y (mgr.25016) 99 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:12.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:12 smithi089 bash[26514]: cluster 2024-09-21T05:20:11.410446+0000 mgr.y (mgr.25016) 99 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:12 smithi110 bash[22020]: cluster 2024-09-21T05:20:11.410446+0000 mgr.y (mgr.25016) 99 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:14.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:14 smithi089 bash[19831]: cluster 2024-09-21T05:20:13.411118+0000 mgr.y (mgr.25016) 100 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:14.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:14 smithi089 bash[26514]: cluster 2024-09-21T05:20:13.411118+0000 mgr.y (mgr.25016) 100 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:14 smithi110 bash[22020]: cluster 2024-09-21T05:20:13.411118+0000 mgr.y (mgr.25016) 100 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:16 smithi110 bash[22020]: cluster 2024-09-21T05:20:15.411796+0000 mgr.y (mgr.25016) 101 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:17.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:16 smithi089 bash[19831]: cluster 2024-09-21T05:20:15.411796+0000 mgr.y (mgr.25016) 101 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:17.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:16 smithi089 bash[26514]: cluster 2024-09-21T05:20:15.411796+0000 mgr.y (mgr.25016) 101 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:18 smithi110 bash[22020]: cluster 2024-09-21T05:20:17.413399+0000 mgr.y (mgr.25016) 102 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:19.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:18 smithi089 bash[19831]: cluster 2024-09-21T05:20:17.413399+0000 mgr.y (mgr.25016) 102 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:19.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:18 smithi089 bash[26514]: cluster 2024-09-21T05:20:17.413399+0000 mgr.y (mgr.25016) 102 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:20 smithi089 bash[19831]: audit 2024-09-21T05:20:18.786236+0000 mgr.y (mgr.25016) 103 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:20 smithi089 bash[19831]: cluster 2024-09-21T05:20:19.414170+0000 mgr.y (mgr.25016) 104 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:21.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:20 smithi089 bash[26514]: audit 2024-09-21T05:20:18.786236+0000 mgr.y (mgr.25016) 103 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:21.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:20 smithi089 bash[26514]: cluster 2024-09-21T05:20:19.414170+0000 mgr.y (mgr.25016) 104 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:20 smithi110 bash[22020]: audit 2024-09-21T05:20:18.786236+0000 mgr.y (mgr.25016) 103 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:20 smithi110 bash[22020]: cluster 2024-09-21T05:20:19.414170+0000 mgr.y (mgr.25016) 104 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:22.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:21 smithi089 bash[19831]: audit 2024-09-21T05:20:20.969559+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:22.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:21 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:21] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.43.0" 2024-09-21T05:20:22.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:21 smithi089 bash[26514]: audit 2024-09-21T05:20:20.969559+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:21 smithi110 bash[22020]: audit 2024-09-21T05:20:20.969559+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:22 smithi089 bash[19831]: cluster 2024-09-21T05:20:21.415737+0000 mgr.y (mgr.25016) 105 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:23.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:22 smithi089 bash[26514]: cluster 2024-09-21T05:20:21.415737+0000 mgr.y (mgr.25016) 105 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:22 smithi110 bash[22020]: cluster 2024-09-21T05:20:21.415737+0000 mgr.y (mgr.25016) 105 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:24.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:23 smithi089 bash[19831]: cluster 2024-09-21T05:20:23.416428+0000 mgr.y (mgr.25016) 106 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:24.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:23 smithi089 bash[26514]: cluster 2024-09-21T05:20:23.416428+0000 mgr.y (mgr.25016) 106 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:23 smithi110 bash[22020]: cluster 2024-09-21T05:20:23.416428+0000 mgr.y (mgr.25016) 106 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:26 smithi089 bash[19831]: cluster 2024-09-21T05:20:25.417095+0000 mgr.y (mgr.25016) 107 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:26.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:26 smithi089 bash[26514]: cluster 2024-09-21T05:20:25.417095+0000 mgr.y (mgr.25016) 107 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:26 smithi110 bash[22020]: cluster 2024-09-21T05:20:25.417095+0000 mgr.y (mgr.25016) 107 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:28.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:28 smithi089 bash[26514]: cluster 2024-09-21T05:20:27.418797+0000 mgr.y (mgr.25016) 108 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:28 smithi089 bash[19831]: cluster 2024-09-21T05:20:27.418797+0000 mgr.y (mgr.25016) 108 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:28 smithi110 bash[22020]: cluster 2024-09-21T05:20:27.418797+0000 mgr.y (mgr.25016) 108 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:30 smithi089 bash[19831]: audit 2024-09-21T05:20:28.797593+0000 mgr.y (mgr.25016) 109 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:30 smithi089 bash[19831]: cluster 2024-09-21T05:20:29.419511+0000 mgr.y (mgr.25016) 110 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:30 smithi089 bash[26514]: audit 2024-09-21T05:20:28.797593+0000 mgr.y (mgr.25016) 109 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:30 smithi089 bash[26514]: cluster 2024-09-21T05:20:29.419511+0000 mgr.y (mgr.25016) 110 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:30 smithi110 bash[22020]: audit 2024-09-21T05:20:28.797593+0000 mgr.y (mgr.25016) 109 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:30 smithi110 bash[22020]: cluster 2024-09-21T05:20:29.419511+0000 mgr.y (mgr.25016) 110 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[19831]: audit 2024-09-21T05:20:30.683723+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[19831]: audit 2024-09-21T05:20:30.685315+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[19831]: audit 2024-09-21T05:20:30.695136+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[26514]: audit 2024-09-21T05:20:30.683723+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[26514]: audit 2024-09-21T05:20:30.685315+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:31.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[26514]: audit 2024-09-21T05:20:30.695136+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:20:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:31 smithi110 bash[22020]: audit 2024-09-21T05:20:30.683723+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:20:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:31 smithi110 bash[22020]: audit 2024-09-21T05:20:30.685315+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:20:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:31 smithi110 bash[22020]: audit 2024-09-21T05:20:30.695136+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:20:32.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:31 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:31] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.43.0" 2024-09-21T05:20:32.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:32 smithi089 bash[19831]: cluster 2024-09-21T05:20:31.421178+0000 mgr.y (mgr.25016) 111 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:32.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:32 smithi089 bash[26514]: cluster 2024-09-21T05:20:31.421178+0000 mgr.y (mgr.25016) 111 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:32.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:32 smithi110 bash[22020]: cluster 2024-09-21T05:20:31.421178+0000 mgr.y (mgr.25016) 111 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:34 smithi089 bash[19831]: cluster 2024-09-21T05:20:33.421911+0000 mgr.y (mgr.25016) 112 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:34.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:34 smithi089 bash[26514]: cluster 2024-09-21T05:20:33.421911+0000 mgr.y (mgr.25016) 112 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:34 smithi110 bash[22020]: cluster 2024-09-21T05:20:33.421911+0000 mgr.y (mgr.25016) 112 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:36 smithi089 bash[19831]: cluster 2024-09-21T05:20:35.422573+0000 mgr.y (mgr.25016) 113 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:36 smithi089 bash[19831]: audit 2024-09-21T05:20:35.969686+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:36 smithi089 bash[26514]: cluster 2024-09-21T05:20:35.422573+0000 mgr.y (mgr.25016) 113 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:36 smithi089 bash[26514]: audit 2024-09-21T05:20:35.969686+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:36 smithi110 bash[22020]: cluster 2024-09-21T05:20:35.422573+0000 mgr.y (mgr.25016) 113 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:36 smithi110 bash[22020]: audit 2024-09-21T05:20:35.969686+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:38 smithi089 bash[19831]: cluster 2024-09-21T05:20:37.424234+0000 mgr.y (mgr.25016) 114 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:38.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:38 smithi089 bash[26514]: cluster 2024-09-21T05:20:37.424234+0000 mgr.y (mgr.25016) 114 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:38 smithi110 bash[22020]: cluster 2024-09-21T05:20:37.424234+0000 mgr.y (mgr.25016) 114 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:40 smithi089 bash[19831]: audit 2024-09-21T05:20:38.806266+0000 mgr.y (mgr.25016) 115 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:40 smithi089 bash[19831]: cluster 2024-09-21T05:20:39.424905+0000 mgr.y (mgr.25016) 116 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:40 smithi089 bash[26514]: audit 2024-09-21T05:20:38.806266+0000 mgr.y (mgr.25016) 115 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:40 smithi089 bash[26514]: cluster 2024-09-21T05:20:39.424905+0000 mgr.y (mgr.25016) 116 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:40 smithi110 bash[22020]: audit 2024-09-21T05:20:38.806266+0000 mgr.y (mgr.25016) 115 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:40 smithi110 bash[22020]: cluster 2024-09-21T05:20:39.424905+0000 mgr.y (mgr.25016) 116 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:42.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:41 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:41] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:20:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:42 smithi089 bash[19831]: cluster 2024-09-21T05:20:41.426483+0000 mgr.y (mgr.25016) 117 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:42 smithi089 bash[26514]: cluster 2024-09-21T05:20:41.426483+0000 mgr.y (mgr.25016) 117 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:42 smithi110 bash[22020]: cluster 2024-09-21T05:20:41.426483+0000 mgr.y (mgr.25016) 117 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:44.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:44 smithi089 bash[19831]: cluster 2024-09-21T05:20:43.427163+0000 mgr.y (mgr.25016) 118 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:44.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:44 smithi089 bash[26514]: cluster 2024-09-21T05:20:43.427163+0000 mgr.y (mgr.25016) 118 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:44 smithi110 bash[22020]: cluster 2024-09-21T05:20:43.427163+0000 mgr.y (mgr.25016) 118 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:46 smithi089 bash[19831]: cluster 2024-09-21T05:20:45.427929+0000 mgr.y (mgr.25016) 119 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:46.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:46 smithi089 bash[26514]: cluster 2024-09-21T05:20:45.427929+0000 mgr.y (mgr.25016) 119 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:46 smithi110 bash[22020]: cluster 2024-09-21T05:20:45.427929+0000 mgr.y (mgr.25016) 119 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:48.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:48 smithi089 bash[26514]: cluster 2024-09-21T05:20:47.429583+0000 mgr.y (mgr.25016) 120 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:48 smithi089 bash[19831]: cluster 2024-09-21T05:20:47.429583+0000 mgr.y (mgr.25016) 120 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:48 smithi110 bash[22020]: cluster 2024-09-21T05:20:47.429583+0000 mgr.y (mgr.25016) 120 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:50 smithi089 bash[19831]: audit 2024-09-21T05:20:48.814279+0000 mgr.y (mgr.25016) 121 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:50 smithi089 bash[19831]: cluster 2024-09-21T05:20:49.430251+0000 mgr.y (mgr.25016) 122 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:50 smithi089 bash[26514]: audit 2024-09-21T05:20:48.814279+0000 mgr.y (mgr.25016) 121 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:50 smithi089 bash[26514]: cluster 2024-09-21T05:20:49.430251+0000 mgr.y (mgr.25016) 122 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:50 smithi110 bash[22020]: audit 2024-09-21T05:20:48.814279+0000 mgr.y (mgr.25016) 121 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:20:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:50 smithi110 bash[22020]: cluster 2024-09-21T05:20:49.430251+0000 mgr.y (mgr.25016) 122 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:51 smithi089 bash[19831]: audit 2024-09-21T05:20:50.970901+0000 mon.a (mon.0) 1172 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:51 smithi089 bash[26514]: audit 2024-09-21T05:20:50.970901+0000 mon.a (mon.0) 1172 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:51 smithi110 bash[22020]: audit 2024-09-21T05:20:50.970901+0000 mon.a (mon.0) 1172 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:20:52.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:20:51 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:20:51] "GET /metrics HTTP/1.1" 200 38241 "" "Prometheus/2.43.0" 2024-09-21T05:20:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:52 smithi089 bash[19831]: cluster 2024-09-21T05:20:51.431904+0000 mgr.y (mgr.25016) 123 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:52.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:52 smithi089 bash[26514]: cluster 2024-09-21T05:20:51.431904+0000 mgr.y (mgr.25016) 123 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:52 smithi110 bash[22020]: cluster 2024-09-21T05:20:51.431904+0000 mgr.y (mgr.25016) 123 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:54 smithi089 bash[19831]: cluster 2024-09-21T05:20:53.432604+0000 mgr.y (mgr.25016) 124 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:54.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:54 smithi089 bash[26514]: cluster 2024-09-21T05:20:53.432604+0000 mgr.y (mgr.25016) 124 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:54 smithi110 bash[22020]: cluster 2024-09-21T05:20:53.432604+0000 mgr.y (mgr.25016) 124 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:56 smithi110 bash[22020]: cluster 2024-09-21T05:20:55.433433+0000 mgr.y (mgr.25016) 125 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:56 smithi089 bash[19831]: cluster 2024-09-21T05:20:55.433433+0000 mgr.y (mgr.25016) 125 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:57.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:56 smithi089 bash[26514]: cluster 2024-09-21T05:20:55.433433+0000 mgr.y (mgr.25016) 125 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:20:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:20:58 smithi110 bash[22020]: cluster 2024-09-21T05:20:57.435129+0000 mgr.y (mgr.25016) 126 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:58.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:20:58 smithi089 bash[19831]: cluster 2024-09-21T05:20:57.435129+0000 mgr.y (mgr.25016) 126 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:20:58.818 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:20:58 smithi089 bash[26514]: cluster 2024-09-21T05:20:57.435129+0000 mgr.y (mgr.25016) 126 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:00 smithi089 bash[19831]: audit 2024-09-21T05:20:58.817943+0000 mgr.y (mgr.25016) 127 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:00 smithi089 bash[19831]: cluster 2024-09-21T05:20:59.435837+0000 mgr.y (mgr.25016) 128 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:00 smithi089 bash[26514]: audit 2024-09-21T05:20:58.817943+0000 mgr.y (mgr.25016) 127 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:00 smithi089 bash[26514]: cluster 2024-09-21T05:20:59.435837+0000 mgr.y (mgr.25016) 128 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:00 smithi110 bash[22020]: audit 2024-09-21T05:20:58.817943+0000 mgr.y (mgr.25016) 127 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:00 smithi110 bash[22020]: cluster 2024-09-21T05:20:59.435837+0000 mgr.y (mgr.25016) 128 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:02.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:01 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:01] "GET /metrics HTTP/1.1" 200 38241 "" "Prometheus/2.43.0" 2024-09-21T05:21:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:02 smithi089 bash[19831]: cluster 2024-09-21T05:21:01.437447+0000 mgr.y (mgr.25016) 129 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:02 smithi089 bash[26514]: cluster 2024-09-21T05:21:01.437447+0000 mgr.y (mgr.25016) 129 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:02 smithi110 bash[22020]: cluster 2024-09-21T05:21:01.437447+0000 mgr.y (mgr.25016) 129 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:04 smithi089 bash[19831]: cluster 2024-09-21T05:21:03.438160+0000 mgr.y (mgr.25016) 130 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:05.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:04 smithi089 bash[26514]: cluster 2024-09-21T05:21:03.438160+0000 mgr.y (mgr.25016) 130 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:04 smithi110 bash[22020]: cluster 2024-09-21T05:21:03.438160+0000 mgr.y (mgr.25016) 130 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:06 smithi089 bash[19831]: cluster 2024-09-21T05:21:05.438876+0000 mgr.y (mgr.25016) 131 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:06 smithi089 bash[19831]: audit 2024-09-21T05:21:05.970714+0000 mon.a (mon.0) 1173 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:07.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:06 smithi089 bash[26514]: cluster 2024-09-21T05:21:05.438876+0000 mgr.y (mgr.25016) 131 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:07.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:06 smithi089 bash[26514]: audit 2024-09-21T05:21:05.970714+0000 mon.a (mon.0) 1173 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:06 smithi110 bash[22020]: cluster 2024-09-21T05:21:05.438876+0000 mgr.y (mgr.25016) 131 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:06 smithi110 bash[22020]: audit 2024-09-21T05:21:05.970714+0000 mon.a (mon.0) 1173 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:08.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:08 smithi089 bash[19831]: cluster 2024-09-21T05:21:07.440505+0000 mgr.y (mgr.25016) 132 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:08.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:08 smithi089 bash[26514]: cluster 2024-09-21T05:21:07.440505+0000 mgr.y (mgr.25016) 132 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:08 smithi110 bash[22020]: cluster 2024-09-21T05:21:07.440505+0000 mgr.y (mgr.25016) 132 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:10 smithi089 bash[19831]: audit 2024-09-21T05:21:08.826245+0000 mgr.y (mgr.25016) 133 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:10 smithi089 bash[19831]: cluster 2024-09-21T05:21:09.441242+0000 mgr.y (mgr.25016) 134 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:11.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:10 smithi089 bash[26514]: audit 2024-09-21T05:21:08.826245+0000 mgr.y (mgr.25016) 133 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:11.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:10 smithi089 bash[26514]: cluster 2024-09-21T05:21:09.441242+0000 mgr.y (mgr.25016) 134 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:10 smithi110 bash[22020]: audit 2024-09-21T05:21:08.826245+0000 mgr.y (mgr.25016) 133 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:10 smithi110 bash[22020]: cluster 2024-09-21T05:21:09.441242+0000 mgr.y (mgr.25016) 134 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:11 smithi089 bash[19831]: cluster 2024-09-21T05:21:11.442806+0000 mgr.y (mgr.25016) 135 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:12.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:11 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:11] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.43.0" 2024-09-21T05:21:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:11 smithi089 bash[26514]: cluster 2024-09-21T05:21:11.442806+0000 mgr.y (mgr.25016) 135 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:11 smithi110 bash[22020]: cluster 2024-09-21T05:21:11.442806+0000 mgr.y (mgr.25016) 135 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:12.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:21:13.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:21:13 smithi110 bash[47061]: logger=cleanup t=2024-09-21T05:21:13.092775417Z level=info msg="Completed cleanup jobs" duration=55.799019ms 2024-09-21T05:21:14.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:14 smithi089 bash[19831]: cluster 2024-09-21T05:21:13.443470+0000 mgr.y (mgr.25016) 136 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:14.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:14 smithi089 bash[26514]: cluster 2024-09-21T05:21:13.443470+0000 mgr.y (mgr.25016) 136 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:14 smithi110 bash[22020]: cluster 2024-09-21T05:21:13.443470+0000 mgr.y (mgr.25016) 136 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:16.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:16 smithi089 bash[19831]: cluster 2024-09-21T05:21:15.444198+0000 mgr.y (mgr.25016) 137 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:16.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:16 smithi089 bash[26514]: cluster 2024-09-21T05:21:15.444198+0000 mgr.y (mgr.25016) 137 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:16 smithi110 bash[22020]: cluster 2024-09-21T05:21:15.444198+0000 mgr.y (mgr.25016) 137 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:17.628 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:18.773 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:18 smithi089 bash[19831]: cluster 2024-09-21T05:21:17.445911+0000 mgr.y (mgr.25016) 138 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:18.774 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:18 smithi089 bash[26514]: cluster 2024-09-21T05:21:17.445911+0000 mgr.y (mgr.25016) 138 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:18 smithi110 bash[22020]: cluster 2024-09-21T05:21:17.445911+0000 mgr.y (mgr.25016) 138 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (20m) 2m ago 20m 14.4M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (20m) 2m ago 20m 75.3M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (3m) 2m ago 18m 47.1M - 3.8 164465d2334a 99f3d0c51f58 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (13m) 2m ago 29m 438M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (6m) 2m ago 31m 494M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (31m) 2m ago 31m 73.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (29m) 2m ago 29m 54.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:21:19.177 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (29m) 2m ago 29m 54.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (20m) 2m ago 20m 9111k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (20m) 2m ago 20m 8767k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (28m) 2m ago 28m 55.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (27m) 2m ago 27m 65.1M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (26m) 2m ago 26m 60.6M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (25m) 2m ago 25m 55.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (24m) 2m ago 24m 69.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (23m) 2m ago 23m 53.8M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (23m) 2m ago 23m 61.5M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (22m) 2m ago 22m 62.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (2m) 2m ago 21m 30.6M - 2.43.0 a07b618ecd1d bd31e682e9ea 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (18m) 2m ago 18m 100M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:21:19.178 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (18m) 2m ago 18m 100M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:21:19.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions' 2024-09-21T05:21:20.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[26514]: audit 2024-09-21T05:21:18.834121+0000 mgr.y (mgr.25016) 139 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:20.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[26514]: audit 2024-09-21T05:21:19.136661+0000 mgr.y (mgr.25016) 140 : audit [DBG] from='client.25106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[26514]: cluster 2024-09-21T05:21:19.446643+0000 mgr.y (mgr.25016) 141 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[19831]: audit 2024-09-21T05:21:18.834121+0000 mgr.y (mgr.25016) 139 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[19831]: audit 2024-09-21T05:21:19.136661+0000 mgr.y (mgr.25016) 140 : audit [DBG] from='client.25106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:20 smithi089 bash[19831]: cluster 2024-09-21T05:21:19.446643+0000 mgr.y (mgr.25016) 141 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:20 smithi110 bash[22020]: audit 2024-09-21T05:21:18.834121+0000 mgr.y (mgr.25016) 139 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:20 smithi110 bash[22020]: audit 2024-09-21T05:21:19.136661+0000 mgr.y (mgr.25016) 140 : audit [DBG] from='client.25106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:21:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:20 smithi110 bash[22020]: cluster 2024-09-21T05:21:19.446643+0000 mgr.y (mgr.25016) 141 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:21.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:21 smithi089 bash[26514]: audit 2024-09-21T05:21:20.971163+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:21 smithi089 bash[19831]: audit 2024-09-21T05:21:20.971163+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:21 smithi110 bash[22020]: audit 2024-09-21T05:21:20.971163+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:22.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:21 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:21] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.43.0" 2024-09-21T05:21:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:22 smithi089 bash[19831]: cluster 2024-09-21T05:21:21.448204+0000 mgr.y (mgr.25016) 142 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:22 smithi089 bash[26514]: cluster 2024-09-21T05:21:21.448204+0000 mgr.y (mgr.25016) 142 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:22 smithi110 bash[22020]: cluster 2024-09-21T05:21:21.448204+0000 mgr.y (mgr.25016) 142 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:24.627 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:24 smithi089 bash[19831]: cluster 2024-09-21T05:21:23.448913+0000 mgr.y (mgr.25016) 143 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:24.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:24 smithi089 bash[26514]: cluster 2024-09-21T05:21:23.448913+0000 mgr.y (mgr.25016) 143 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:24 smithi110 bash[22020]: cluster 2024-09-21T05:21:23.448913+0000 mgr.y (mgr.25016) 143 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:26.205 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:21:26.205 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:21:26.206 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:21:26.207 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:21:26.207 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:21:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:26 smithi089 bash[19831]: cluster 2024-09-21T05:21:25.449639+0000 mgr.y (mgr.25016) 144 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:26 smithi089 bash[19831]: audit 2024-09-21T05:21:26.205979+0000 mon.c (mon.2) 171 : audit [DBG] from='client.? 172.21.15.89:0/3231525865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:26.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:26 smithi089 bash[26514]: cluster 2024-09-21T05:21:25.449639+0000 mgr.y (mgr.25016) 144 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:26.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:26 smithi089 bash[26514]: audit 2024-09-21T05:21:26.205979+0000 mon.c (mon.2) 171 : audit [DBG] from='client.? 172.21.15.89:0/3231525865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:26 smithi110 bash[22020]: cluster 2024-09-21T05:21:25.449639+0000 mgr.y (mgr.25016) 144 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:26 smithi110 bash[22020]: audit 2024-09-21T05:21:26.205979+0000 mon.c (mon.2) 171 : audit [DBG] from='client.? 172.21.15.89:0/3231525865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:26.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph -s' 2024-09-21T05:21:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:28 smithi089 bash[19831]: cluster 2024-09-21T05:21:27.451270+0000 mgr.y (mgr.25016) 145 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:28.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:28 smithi089 bash[26514]: cluster 2024-09-21T05:21:27.451270+0000 mgr.y (mgr.25016) 145 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:28 smithi110 bash[22020]: cluster 2024-09-21T05:21:27.451270+0000 mgr.y (mgr.25016) 145 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:30 smithi089 bash[19831]: audit 2024-09-21T05:21:28.845131+0000 mgr.y (mgr.25016) 146 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:30 smithi089 bash[19831]: cluster 2024-09-21T05:21:29.451975+0000 mgr.y (mgr.25016) 147 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:30 smithi089 bash[26514]: audit 2024-09-21T05:21:28.845131+0000 mgr.y (mgr.25016) 146 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:30 smithi089 bash[26514]: cluster 2024-09-21T05:21:29.451975+0000 mgr.y (mgr.25016) 147 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:30 smithi110 bash[22020]: audit 2024-09-21T05:21:28.845131+0000 mgr.y (mgr.25016) 146 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:30 smithi110 bash[22020]: cluster 2024-09-21T05:21:29.451975+0000 mgr.y (mgr.25016) 147 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:31.691 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:32.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:31 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:31] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.43.0" 2024-09-21T05:21:32.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: audit 2024-09-21T05:21:31.335176+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: audit 2024-09-21T05:21:31.342132+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: cluster 2024-09-21T05:21:31.452909+0000 mgr.y (mgr.25016) 148 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: audit 2024-09-21T05:21:31.972701+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: audit 2024-09-21T05:21:31.973497+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[19831]: audit 2024-09-21T05:21:31.978823+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: audit 2024-09-21T05:21:31.335176+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: audit 2024-09-21T05:21:31.342132+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: cluster 2024-09-21T05:21:31.452909+0000 mgr.y (mgr.25016) 148 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: audit 2024-09-21T05:21:31.972701+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: audit 2024-09-21T05:21:31.973497+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:32.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:32 smithi089 bash[26514]: audit 2024-09-21T05:21:31.978823+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: audit 2024-09-21T05:21:31.335176+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: audit 2024-09-21T05:21:31.342132+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: cluster 2024-09-21T05:21:31.452909+0000 mgr.y (mgr.25016) 148 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: audit 2024-09-21T05:21:31.972701+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: audit 2024-09-21T05:21:31.973497+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:21:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:32 smithi110 bash[22020]: audit 2024-09-21T05:21:31.978823+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: cluster: 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: id: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: health: HEALTH_OK 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: services: 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: mon: 3 daemons, quorum a,b,c (age 29m) 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: mgr: y(active, since 3m), standbys: x 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: osd: 8 osds: 8 up (since 22m), 8 in (since 22m) 2024-09-21T05:21:33.473 INFO:teuthology.orchestra.run.smithi089.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: data: 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: pools: 6 pools, 161 pgs 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: objects: 244 objects, 585 KiB 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: usage: 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: pgs: 161 active+clean 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: io: 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-09-21T05:21:33.474 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T05:21:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:33 smithi089 bash[19831]: audit 2024-09-21T05:21:33.473653+0000 mon.c (mon.2) 172 : audit [DBG] from='client.? 172.21.15.89:0/3584126040' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:21:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:33 smithi089 bash[26514]: audit 2024-09-21T05:21:33.473653+0000 mon.c (mon.2) 172 : audit [DBG] from='client.? 172.21.15.89:0/3584126040' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:21:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:33 smithi110 bash[22020]: audit 2024-09-21T05:21:33.473653+0000 mon.c (mon.2) 172 : audit [DBG] from='client.? 172.21.15.89:0/3584126040' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T05:21:34.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:21:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:34 smithi089 bash[19831]: cluster 2024-09-21T05:21:33.453649+0000 mgr.y (mgr.25016) 149 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:34.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:34 smithi089 bash[26514]: cluster 2024-09-21T05:21:33.453649+0000 mgr.y (mgr.25016) 149 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:34 smithi110 bash[22020]: cluster 2024-09-21T05:21:33.453649+0000 mgr.y (mgr.25016) 149 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:36 smithi089 bash[19831]: cluster 2024-09-21T05:21:35.454264+0000 mgr.y (mgr.25016) 150 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:36 smithi089 bash[19831]: audit 2024-09-21T05:21:35.971458+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:36 smithi089 bash[26514]: cluster 2024-09-21T05:21:35.454264+0000 mgr.y (mgr.25016) 150 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:36 smithi089 bash[26514]: audit 2024-09-21T05:21:35.971458+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:36 smithi110 bash[22020]: cluster 2024-09-21T05:21:35.454264+0000 mgr.y (mgr.25016) 150 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:36 smithi110 bash[22020]: audit 2024-09-21T05:21:35.971458+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:38 smithi089 bash[19831]: cluster 2024-09-21T05:21:37.456015+0000 mgr.y (mgr.25016) 151 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:38 smithi089 bash[26514]: cluster 2024-09-21T05:21:37.456015+0000 mgr.y (mgr.25016) 151 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:38 smithi110 bash[22020]: cluster 2024-09-21T05:21:37.456015+0000 mgr.y (mgr.25016) 151 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:38.985 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:40.465 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:21:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[19831]: audit 2024-09-21T05:21:38.856364+0000 mgr.y (mgr.25016) 152 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[19831]: cluster 2024-09-21T05:21:39.456718+0000 mgr.y (mgr.25016) 153 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[19831]: audit 2024-09-21T05:21:40.466654+0000 mon.c (mon.2) 173 : audit [DBG] from='client.? 172.21.15.89:0/1612236260' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:21:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[26514]: audit 2024-09-21T05:21:38.856364+0000 mgr.y (mgr.25016) 152 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[26514]: cluster 2024-09-21T05:21:39.456718+0000 mgr.y (mgr.25016) 153 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:40 smithi089 bash[26514]: audit 2024-09-21T05:21:40.466654+0000 mon.c (mon.2) 173 : audit [DBG] from='client.? 172.21.15.89:0/1612236260' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:21:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:40 smithi110 bash[22020]: audit 2024-09-21T05:21:38.856364+0000 mgr.y (mgr.25016) 152 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:40 smithi110 bash[22020]: cluster 2024-09-21T05:21:39.456718+0000 mgr.y (mgr.25016) 153 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:40 smithi110 bash[22020]: audit 2024-09-21T05:21:40.466654+0000 mon.c (mon.2) 173 : audit [DBG] from='client.? 172.21.15.89:0/1612236260' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:21:41.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T05:21:42.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:41 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:41] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.43.0" 2024-09-21T05:21:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:42 smithi110 bash[22020]: cluster 2024-09-21T05:21:41.458296+0000 mgr.y (mgr.25016) 154 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:42 smithi089 bash[19831]: cluster 2024-09-21T05:21:41.458296+0000 mgr.y (mgr.25016) 154 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:43.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:42 smithi089 bash[26514]: cluster 2024-09-21T05:21:41.458296+0000 mgr.y (mgr.25016) 154 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:44 smithi110 bash[22020]: cluster 2024-09-21T05:21:43.458902+0000 mgr.y (mgr.25016) 155 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:44 smithi089 bash[19831]: cluster 2024-09-21T05:21:43.458902+0000 mgr.y (mgr.25016) 155 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:45.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:44 smithi089 bash[26514]: cluster 2024-09-21T05:21:43.458902+0000 mgr.y (mgr.25016) 155 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:46.003 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:46 smithi089 bash[19831]: cluster 2024-09-21T05:21:45.459593+0000 mgr.y (mgr.25016) 156 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:46 smithi089 bash[26514]: cluster 2024-09-21T05:21:45.459593+0000 mgr.y (mgr.25016) 156 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:47.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:46 smithi110 bash[22020]: cluster 2024-09-21T05:21:45.459593+0000 mgr.y (mgr.25016) 156 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:47.511 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:21:48.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph mgr fail' 2024-09-21T05:21:48.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:48 smithi089 bash[19831]: cluster 2024-09-21T05:21:47.461164+0000 mgr.y (mgr.25016) 157 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:48.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:48 smithi089 bash[19831]: audit 2024-09-21T05:21:47.500669+0000 mon.a (mon.0) 1181 : audit [DBG] from='client.? 172.21.15.89:0/2141602352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:48.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:48 smithi089 bash[26514]: cluster 2024-09-21T05:21:47.461164+0000 mgr.y (mgr.25016) 157 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:48.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:48 smithi089 bash[26514]: audit 2024-09-21T05:21:47.500669+0000 mon.a (mon.0) 1181 : audit [DBG] from='client.? 172.21.15.89:0/2141602352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:48 smithi110 bash[22020]: cluster 2024-09-21T05:21:47.461164+0000 mgr.y (mgr.25016) 157 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:48 smithi110 bash[22020]: audit 2024-09-21T05:21:47.500669+0000 mon.a (mon.0) 1181 : audit [DBG] from='client.? 172.21.15.89:0/2141602352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:21:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:50 smithi089 bash[19831]: audit 2024-09-21T05:21:48.867536+0000 mgr.y (mgr.25016) 158 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:50 smithi089 bash[19831]: cluster 2024-09-21T05:21:49.461960+0000 mgr.y (mgr.25016) 159 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:50 smithi089 bash[26514]: audit 2024-09-21T05:21:48.867536+0000 mgr.y (mgr.25016) 158 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:50 smithi089 bash[26514]: cluster 2024-09-21T05:21:49.461960+0000 mgr.y (mgr.25016) 159 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:50 smithi110 bash[22020]: audit 2024-09-21T05:21:48.867536+0000 mgr.y (mgr.25016) 158 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:21:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:50 smithi110 bash[22020]: cluster 2024-09-21T05:21:49.461960+0000 mgr.y (mgr.25016) 159 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:51.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:51 smithi089 bash[19831]: audit 2024-09-21T05:21:50.971384+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:51 smithi089 bash[26514]: audit 2024-09-21T05:21:50.971384+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:51 smithi110 bash[22020]: audit 2024-09-21T05:21:50.971384+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.25016 172.21.15.89:0/265729774' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:52.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:51 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:21:51] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.43.0" 2024-09-21T05:21:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:52 smithi089 bash[19831]: cluster 2024-09-21T05:21:51.463644+0000 mgr.y (mgr.25016) 160 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:52 smithi089 bash[26514]: cluster 2024-09-21T05:21:51.463644+0000 mgr.y (mgr.25016) 160 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:52 smithi110 bash[22020]: cluster 2024-09-21T05:21:51.463644+0000 mgr.y (mgr.25016) 160 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:21:53.006 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:21:54.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[68019]: ignoring --setuser ceph since I am not root 2024-09-21T05:21:54.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[68019]: ignoring --setgroup ceph since I am not root 2024-09-21T05:21:54.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[68019]: debug 2024-09-21T05:21:54.570+0000 7f1af3f98640 1 -- 172.21.15.89:0/1457128450 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558f20230e0 con 0x5558f2025400 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: cluster 2024-09-21T05:21:53.464343+0000 mgr.y (mgr.25016) 161 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.500423+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: cluster 2024-09-21T05:21:54.501241+0000 mon.a (mon.0) 1184 : cluster [INF] Activating manager daemon x 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.507176+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: cluster 2024-09-21T05:21:54.514336+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: cluster 2024-09-21T05:21:54.515319+0000 mon.a (mon.0) 1187 : cluster [DBG] mgrmap e33: x(active, starting, since 0.0134077s) 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.523261+0000 mon.c (mon.2) 174 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.523478+0000 mon.c (mon.2) 175 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.523671+0000 mon.c (mon.2) 176 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:21:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.524695+0000 mon.c (mon.2) 177 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.525002+0000 mon.c (mon.2) 178 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.525310+0000 mon.c (mon.2) 179 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.525594+0000 mon.c (mon.2) 180 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.525880+0000 mon.c (mon.2) 181 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.526148+0000 mon.c (mon.2) 182 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.526415+0000 mon.c (mon.2) 183 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.526698+0000 mon.c (mon.2) 184 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.526979+0000 mon.c (mon.2) 185 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.527933+0000 mon.c (mon.2) 186 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.528142+0000 mon.c (mon.2) 187 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[26514]: audit 2024-09-21T05:21:54.528861+0000 mon.c (mon.2) 188 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:21:54.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: cluster 2024-09-21T05:21:53.464343+0000 mgr.y (mgr.25016) 161 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.500423+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: cluster 2024-09-21T05:21:54.501241+0000 mon.a (mon.0) 1184 : cluster [INF] Activating manager daemon x 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.507176+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: cluster 2024-09-21T05:21:54.514336+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: cluster 2024-09-21T05:21:54.515319+0000 mon.a (mon.0) 1187 : cluster [DBG] mgrmap e33: x(active, starting, since 0.0134077s) 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.523261+0000 mon.c (mon.2) 174 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.523478+0000 mon.c (mon.2) 175 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.523671+0000 mon.c (mon.2) 176 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.524695+0000 mon.c (mon.2) 177 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.525002+0000 mon.c (mon.2) 178 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.525310+0000 mon.c (mon.2) 179 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.525594+0000 mon.c (mon.2) 180 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.525880+0000 mon.c (mon.2) 181 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.526148+0000 mon.c (mon.2) 182 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.526415+0000 mon.c (mon.2) 183 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:21:54.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.526698+0000 mon.c (mon.2) 184 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:21:54.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.526979+0000 mon.c (mon.2) 185 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:21:54.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.527933+0000 mon.c (mon.2) 186 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:21:54.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.528142+0000 mon.c (mon.2) 187 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:21:54.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:54 smithi089 bash[19831]: audit 2024-09-21T05:21:54.528861+0000 mon.c (mon.2) 188 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:21:54.804 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[50043]: [21/Sep/2024:05:21:54] ENGINE Bus STOPPING 2024-09-21T05:21:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: cluster 2024-09-21T05:21:53.464343+0000 mgr.y (mgr.25016) 161 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:21:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.500423+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-09-21T05:21:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: cluster 2024-09-21T05:21:54.501241+0000 mon.a (mon.0) 1184 : cluster [INF] Activating manager daemon x 2024-09-21T05:21:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.507176+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? 172.21.15.89:0/246318491' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: cluster 2024-09-21T05:21:54.514336+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: cluster 2024-09-21T05:21:54.515319+0000 mon.a (mon.0) 1187 : cluster [DBG] mgrmap e33: x(active, starting, since 0.0134077s) 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.523261+0000 mon.c (mon.2) 174 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.523478+0000 mon.c (mon.2) 175 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.523671+0000 mon.c (mon.2) 176 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.524695+0000 mon.c (mon.2) 177 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.525002+0000 mon.c (mon.2) 178 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.525310+0000 mon.c (mon.2) 179 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.525594+0000 mon.c (mon.2) 180 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.525880+0000 mon.c (mon.2) 181 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.526148+0000 mon.c (mon.2) 182 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.526415+0000 mon.c (mon.2) 183 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.526698+0000 mon.c (mon.2) 184 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.526979+0000 mon.c (mon.2) 185 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:21:54.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.527933+0000 mon.c (mon.2) 186 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:21:54.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.528142+0000 mon.c (mon.2) 187 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:21:54.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[22020]: audit 2024-09-21T05:21:54.528861+0000 mon.c (mon.2) 188 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:21:55.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'sleep 180' 2024-09-21T05:21:55.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[50043]: [21/Sep/2024:05:21:54] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:21:55.303 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:54 smithi110 bash[50043]: [21/Sep/2024:05:21:54] ENGINE Bus STOPPED 2024-09-21T05:21:55.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: cluster 2024-09-21T05:21:54.964792+0000 mon.a (mon.0) 1188 : cluster [INF] Manager daemon x is now available 2024-09-21T05:21:55.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.331588+0000 mon.c (mon.2) 189 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:55.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.331918+0000 mon.c (mon.2) 190 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:55.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.340728+0000 mon.c (mon.2) 191 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.341298+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.375144+0000 mon.c (mon.2) 192 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[19831]: audit 2024-09-21T05:21:55.375517+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: cluster 2024-09-21T05:21:54.964792+0000 mon.a (mon.0) 1188 : cluster [INF] Manager daemon x is now available 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.331588+0000 mon.c (mon.2) 189 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.331918+0000 mon.c (mon.2) 190 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.340728+0000 mon.c (mon.2) 191 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.341298+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.375144+0000 mon.c (mon.2) 192 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:55.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:55 smithi089 bash[26514]: audit 2024-09-21T05:21:55.375517+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[50043]: [21/Sep/2024:05:21:55] ENGINE Bus STARTING 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[50043]: [21/Sep/2024:05:21:55] ENGINE Serving on http://:::9283 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[50043]: [21/Sep/2024:05:21:55] ENGINE Bus STARTED 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: cluster 2024-09-21T05:21:54.964792+0000 mon.a (mon.0) 1188 : cluster [INF] Manager daemon x is now available 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.331588+0000 mon.c (mon.2) 189 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.331918+0000 mon.c (mon.2) 190 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.340728+0000 mon.c (mon.2) 191 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.341298+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.375144+0000 mon.c (mon.2) 192 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:55.754 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:55 smithi110 bash[22020]: audit 2024-09-21T05:21:55.375517+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-21T05:21:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[22020]: cluster 2024-09-21T05:21:55.546330+0000 mon.a (mon.0) 1191 : cluster [DBG] mgrmap e34: x(active, since 1.04509s) 2024-09-21T05:21:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[22020]: audit 2024-09-21T05:21:55.558623+0000 mgr.x (mgr.24511) 1 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[22020]: cluster 2024-09-21T05:21:55.559713+0000 mgr.x (mgr.24511) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:21:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[19831]: cluster 2024-09-21T05:21:55.546330+0000 mon.a (mon.0) 1191 : cluster [DBG] mgrmap e34: x(active, since 1.04509s) 2024-09-21T05:21:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[19831]: audit 2024-09-21T05:21:55.558623+0000 mgr.x (mgr.24511) 1 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[19831]: cluster 2024-09-21T05:21:55.559713+0000 mgr.x (mgr.24511) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:21:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[26514]: cluster 2024-09-21T05:21:55.546330+0000 mon.a (mon.0) 1191 : cluster [DBG] mgrmap e34: x(active, since 1.04509s) 2024-09-21T05:21:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[26514]: audit 2024-09-21T05:21:55.558623+0000 mgr.x (mgr.24511) 1 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:21:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:56 smithi089 bash[26514]: cluster 2024-09-21T05:21:55.559713+0000 mgr.x (mgr.24511) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:21:57.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: debug 2024-09-21T05:21:56.858+0000 7f06db61c640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:21:56] ENGINE Error in HTTPServer.serve 2024-09-21T05:21:57.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: Traceback (most recent call last): 2024-09-21T05:21:57.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: self._connections.run(self.expiration_interval) 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: self._run(expiration_interval) 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: s = self.context.wrap_socket( 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: return self.sslsocket_class._create( 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: self.do_handshake() 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:21:57.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: self._sslobj.do_handshake() 2024-09-21T05:21:57.306 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:21:56 smithi110 bash[50043]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: cephadm 2024-09-21T05:21:56.737535+0000 mgr.x (mgr.24511) 4 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTING 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: cephadm 2024-09-21T05:21:56.857010+0000 mgr.x (mgr.24511) 5 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: cephadm 2024-09-21T05:21:56.860766+0000 mgr.x (mgr.24511) 6 : cephadm [ERR] [21/Sep/2024:05:21:56] ENGINE Error in HTTPServer.serve 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: Traceback (most recent call last): 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: self._connections.run(self.expiration_interval) 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: self._run(expiration_interval) 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:21:57.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: s = self.context.wrap_socket( 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: return self.sslsocket_class._create( 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: self.do_handshake() 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: self._sslobj.do_handshake() 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: cephadm 2024-09-21T05:21:56.958465+0000 mgr.x (mgr.24511) 7 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:21:57.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:57 smithi110 bash[22020]: cephadm 2024-09-21T05:21:56.958605+0000 mgr.x (mgr.24511) 8 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTED 2024-09-21T05:21:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: cephadm 2024-09-21T05:21:56.737535+0000 mgr.x (mgr.24511) 4 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTING 2024-09-21T05:21:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: cephadm 2024-09-21T05:21:56.857010+0000 mgr.x (mgr.24511) 5 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:21:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: cephadm 2024-09-21T05:21:56.860766+0000 mgr.x (mgr.24511) 6 : cephadm [ERR] [21/Sep/2024:05:21:56] ENGINE Error in HTTPServer.serve 2024-09-21T05:21:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T05:21:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: self.do_handshake() 2024-09-21T05:21:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: cephadm 2024-09-21T05:21:56.958465+0000 mgr.x (mgr.24511) 7 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[19831]: cephadm 2024-09-21T05:21:56.958605+0000 mgr.x (mgr.24511) 8 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTED 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: cephadm 2024-09-21T05:21:56.737535+0000 mgr.x (mgr.24511) 4 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTING 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: cephadm 2024-09-21T05:21:56.857010+0000 mgr.x (mgr.24511) 5 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on https://172.21.15.110:7150 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: cephadm 2024-09-21T05:21:56.860766+0000 mgr.x (mgr.24511) 6 : cephadm [ERR] [21/Sep/2024:05:21:56] ENGINE Error in HTTPServer.serve 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: Traceback (most recent call last): 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: self._connections.run(self.expiration_interval) 2024-09-21T05:21:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: self._run(expiration_interval) 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: s = self.context.wrap_socket( 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: return self.sslsocket_class._create( 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: self.do_handshake() 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: self._sslobj.do_handshake() 2024-09-21T05:21:58.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:21:58.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: cephadm 2024-09-21T05:21:56.958465+0000 mgr.x (mgr.24511) 7 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Serving on http://172.21.15.110:8765 2024-09-21T05:21:58.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:57 smithi089 bash[26514]: cephadm 2024-09-21T05:21:56.958605+0000 mgr.x (mgr.24511) 8 : cephadm [INF] [21/Sep/2024:05:21:56] ENGINE Bus STARTED 2024-09-21T05:21:58.878 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:58 smithi089 bash[19831]: cluster 2024-09-21T05:21:57.563956+0000 mon.a (mon.0) 1192 : cluster [DBG] mgrmap e35: x(active, since 3s) 2024-09-21T05:21:58.879 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:58 smithi089 bash[26514]: cluster 2024-09-21T05:21:57.563956+0000 mon.a (mon.0) 1192 : cluster [DBG] mgrmap e35: x(active, since 3s) 2024-09-21T05:21:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:58 smithi110 bash[22020]: cluster 2024-09-21T05:21:57.563956+0000 mon.a (mon.0) 1192 : cluster [DBG] mgrmap e35: x(active, since 3s) 2024-09-21T05:22:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:59 smithi089 bash[19831]: cluster 2024-09-21T05:21:58.529439+0000 mgr.x (mgr.24511) 9 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:21:59 smithi089 bash[19831]: audit 2024-09-21T05:21:58.879619+0000 mgr.x (mgr.24511) 10 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:59 smithi089 bash[26514]: cluster 2024-09-21T05:21:58.529439+0000 mgr.x (mgr.24511) 9 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:21:59 smithi089 bash[26514]: audit 2024-09-21T05:21:58.879619+0000 mgr.x (mgr.24511) 10 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:59 smithi110 bash[22020]: cluster 2024-09-21T05:21:58.529439+0000 mgr.x (mgr.24511) 9 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:21:59 smithi110 bash[22020]: audit 2024-09-21T05:21:58.879619+0000 mgr.x (mgr.24511) 10 : audit [DBG] from='client.25091 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:00.072 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:22:01.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:00 smithi089 bash[68019]: [21/Sep/2024:05:22:00] ENGINE Bus STARTING 2024-09-21T05:22:01.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:00 smithi089 bash[68019]: CherryPy Checker: 2024-09-21T05:22:01.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:00 smithi089 bash[68019]: The Application mounted at '' has an empty config. 2024-09-21T05:22:01.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:00 smithi089 bash[68019]: [21/Sep/2024:05:22:00] ENGINE Serving on http://:::9283 2024-09-21T05:22:01.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:00 smithi089 bash[68019]: [21/Sep/2024:05:22:00] ENGINE Bus STARTED 2024-09-21T05:22:02.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:22:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: cluster 2024-09-21T05:22:00.530144+0000 mgr.x (mgr.24511) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: cluster 2024-09-21T05:22:00.780021+0000 mon.a (mon.0) 1193 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.782513+0000 mon.c (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.783128+0000 mon.c (mon.2) 194 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.785822+0000 mon.c (mon.2) 195 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.786227+0000 mon.c (mon.2) 196 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.874388+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[26514]: audit 2024-09-21T05:22:00.882180+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: cluster 2024-09-21T05:22:00.530144+0000 mgr.x (mgr.24511) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: cluster 2024-09-21T05:22:00.780021+0000 mon.a (mon.0) 1193 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.782513+0000 mon.c (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.783128+0000 mon.c (mon.2) 194 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.785822+0000 mon.c (mon.2) 195 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.786227+0000 mon.c (mon.2) 196 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.874388+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:02.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:01 smithi089 bash[19831]: audit 2024-09-21T05:22:00.882180+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: cluster 2024-09-21T05:22:00.530144+0000 mgr.x (mgr.24511) 11 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: cluster 2024-09-21T05:22:00.780021+0000 mon.a (mon.0) 1193 : cluster [DBG] Standby manager daemon y started 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.782513+0000 mon.c (mon.2) 193 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.783128+0000 mon.c (mon.2) 194 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.785822+0000 mon.c (mon.2) 195 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-21T05:22:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.786227+0000 mon.c (mon.2) 196 : audit [DBG] from='mgr.? 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:22:02.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.874388+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:02.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:01 smithi110 bash[22020]: audit 2024-09-21T05:22:00.882180+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: cluster 2024-09-21T05:22:01.592660+0000 mon.a (mon.0) 1196 : cluster [DBG] mgrmap e36: x(active, since 7s), standbys: y 2024-09-21T05:22:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: audit 2024-09-21T05:22:01.599816+0000 mon.c (mon.2) 197 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:22:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: audit 2024-09-21T05:22:01.773162+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: audit 2024-09-21T05:22:01.784878+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: audit 2024-09-21T05:22:01.921287+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[19831]: audit 2024-09-21T05:22:01.931736+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: cluster 2024-09-21T05:22:01.592660+0000 mon.a (mon.0) 1196 : cluster [DBG] mgrmap e36: x(active, since 7s), standbys: y 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: audit 2024-09-21T05:22:01.599816+0000 mon.c (mon.2) 197 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: audit 2024-09-21T05:22:01.773162+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: audit 2024-09-21T05:22:01.784878+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: audit 2024-09-21T05:22:01.921287+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:02 smithi089 bash[26514]: audit 2024-09-21T05:22:01.931736+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: cluster 2024-09-21T05:22:01.592660+0000 mon.a (mon.0) 1196 : cluster [DBG] mgrmap e36: x(active, since 7s), standbys: y 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: audit 2024-09-21T05:22:01.599816+0000 mon.c (mon.2) 197 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: audit 2024-09-21T05:22:01.773162+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: audit 2024-09-21T05:22:01.784878+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: audit 2024-09-21T05:22:01.921287+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:02 smithi110 bash[22020]: audit 2024-09-21T05:22:01.931736+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cluster 2024-09-21T05:22:02.531146+0000 mgr.x (mgr.24511) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:22:04.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:02.878299+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:02.890723+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:02.894829+0000 mon.c (mon.2) 198 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:02.896275+0000 mon.c (mon.2) 199 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:02.898481+0000 mgr.x (mgr.24511) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:02.898698+0000 mgr.x (mgr.24511) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:02.998425+0000 mgr.x (mgr.24511) 15 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.007058+0000 mgr.x (mgr.24511) 16 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.075724+0000 mgr.x (mgr.24511) 17 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.093475+0000 mgr.x (mgr.24511) 18 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.154866+0000 mgr.x (mgr.24511) 19 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.174459+0000 mgr.x (mgr.24511) 20 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.245658+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.257812+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.266024+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.274808+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.281768+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.306740+0000 mon.c (mon.2) 200 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.306752+0000 mgr.x (mgr.24511) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.307403+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: audit 2024-09-21T05:22:03.317298+0000 mon.c (mon.2) 201 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[19831]: cephadm 2024-09-21T05:22:03.319587+0000 mgr.x (mgr.24511) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cluster 2024-09-21T05:22:02.531146+0000 mgr.x (mgr.24511) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:02.878299+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:02.890723+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:02.894829+0000 mon.c (mon.2) 198 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:02.896275+0000 mon.c (mon.2) 199 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:02.898481+0000 mgr.x (mgr.24511) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:22:04.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:02.898698+0000 mgr.x (mgr.24511) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:02.998425+0000 mgr.x (mgr.24511) 15 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.007058+0000 mgr.x (mgr.24511) 16 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.075724+0000 mgr.x (mgr.24511) 17 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.093475+0000 mgr.x (mgr.24511) 18 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.154866+0000 mgr.x (mgr.24511) 19 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.174459+0000 mgr.x (mgr.24511) 20 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.245658+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.257812+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.266024+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.274808+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.281768+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.306740+0000 mon.c (mon.2) 200 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.306752+0000 mgr.x (mgr.24511) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.307403+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: audit 2024-09-21T05:22:03.317298+0000 mon.c (mon.2) 201 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:03 smithi089 bash[26514]: cephadm 2024-09-21T05:22:03.319587+0000 mgr.x (mgr.24511) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:22:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cluster 2024-09-21T05:22:02.531146+0000 mgr.x (mgr.24511) 12 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:22:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:02.878299+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:02.890723+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:02.894829+0000 mon.c (mon.2) 198 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:02.896275+0000 mon.c (mon.2) 199 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:02.898481+0000 mgr.x (mgr.24511) 13 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:02.898698+0000 mgr.x (mgr.24511) 14 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:02.998425+0000 mgr.x (mgr.24511) 15 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.007058+0000 mgr.x (mgr.24511) 16 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.075724+0000 mgr.x (mgr.24511) 17 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.093475+0000 mgr.x (mgr.24511) 18 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.154866+0000 mgr.x (mgr.24511) 19 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.174459+0000 mgr.x (mgr.24511) 20 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.245658+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.257812+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.266024+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.274808+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.281768+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.306740+0000 mon.c (mon.2) 200 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.306752+0000 mgr.x (mgr.24511) 21 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.307403+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: audit 2024-09-21T05:22:03.317298+0000 mon.c (mon.2) 201 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:04.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:03 smithi110 bash[22020]: cephadm 2024-09-21T05:22:03.319587+0000 mgr.x (mgr.24511) 22 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:22:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:05 smithi089 bash[19831]: cluster 2024-09-21T05:22:04.531892+0000 mgr.x (mgr.24511) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:22:06.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:05 smithi089 bash[26514]: cluster 2024-09-21T05:22:04.531892+0000 mgr.x (mgr.24511) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:22:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:05 smithi110 bash[22020]: cluster 2024-09-21T05:22:04.531892+0000 mgr.x (mgr.24511) 23 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:22:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:07 smithi110 bash[22020]: cluster 2024-09-21T05:22:06.533480+0000 mgr.x (mgr.24511) 24 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:22:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:07 smithi110 bash[22020]: audit 2024-09-21T05:22:06.582148+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:07 smithi110 bash[22020]: audit 2024-09-21T05:22:06.591286+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:07 smithi110 bash[22020]: cephadm 2024-09-21T05:22:06.596474+0000 mgr.x (mgr.24511) 25 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:22:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:07 smithi110 bash[22020]: cephadm 2024-09-21T05:22:06.895090+0000 mgr.x (mgr.24511) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[19831]: cluster 2024-09-21T05:22:06.533480+0000 mgr.x (mgr.24511) 24 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[19831]: audit 2024-09-21T05:22:06.582148+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[19831]: audit 2024-09-21T05:22:06.591286+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[19831]: cephadm 2024-09-21T05:22:06.596474+0000 mgr.x (mgr.24511) 25 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[19831]: cephadm 2024-09-21T05:22:06.895090+0000 mgr.x (mgr.24511) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[26514]: cluster 2024-09-21T05:22:06.533480+0000 mgr.x (mgr.24511) 24 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[26514]: audit 2024-09-21T05:22:06.582148+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[26514]: audit 2024-09-21T05:22:06.591286+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:07.936 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[26514]: cephadm 2024-09-21T05:22:06.596474+0000 mgr.x (mgr.24511) 25 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:22:07.937 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:07 smithi089 bash[26514]: cephadm 2024-09-21T05:22:06.895090+0000 mgr.x (mgr.24511) 26 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:22:08.935 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:08 smithi110 bash[22020]: audit 2024-09-21T05:22:08.227273+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.89:0/3190595256' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:22:08.935 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:08 smithi110 bash[22020]: audit 2024-09-21T05:22:08.547909+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.89:0/68567434' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:08.935 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:08 smithi110 bash[22020]: audit 2024-09-21T05:22:08.548487+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[19831]: audit 2024-09-21T05:22:08.227273+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.89:0/3190595256' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:22:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[19831]: audit 2024-09-21T05:22:08.547909+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.89:0/68567434' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[19831]: audit 2024-09-21T05:22:08.548487+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[26514]: audit 2024-09-21T05:22:08.227273+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.89:0/3190595256' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:22:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[26514]: audit 2024-09-21T05:22:08.547909+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.89:0/68567434' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:08 smithi089 bash[26514]: audit 2024-09-21T05:22:08.548487+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]: dispatch 2024-09-21T05:22:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:09 smithi110 bash[22020]: cluster 2024-09-21T05:22:08.534358+0000 mgr.x (mgr.24511) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:22:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:09 smithi110 bash[22020]: audit 2024-09-21T05:22:08.583686+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]': finished 2024-09-21T05:22:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:09 smithi110 bash[22020]: cluster 2024-09-21T05:22:08.590553+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-21T05:22:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:09 smithi110 bash[22020]: audit 2024-09-21T05:22:08.912179+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]: dispatch 2024-09-21T05:22:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[19831]: cluster 2024-09-21T05:22:08.534358+0000 mgr.x (mgr.24511) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:22:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[19831]: audit 2024-09-21T05:22:08.583686+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]': finished 2024-09-21T05:22:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[19831]: cluster 2024-09-21T05:22:08.590553+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-21T05:22:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[19831]: audit 2024-09-21T05:22:08.912179+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]: dispatch 2024-09-21T05:22:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[26514]: cluster 2024-09-21T05:22:08.534358+0000 mgr.x (mgr.24511) 27 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:22:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[26514]: audit 2024-09-21T05:22:08.583686+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2896199890"}]': finished 2024-09-21T05:22:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[26514]: cluster 2024-09-21T05:22:08.590553+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-09-21T05:22:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:09 smithi089 bash[26514]: audit 2024-09-21T05:22:08.912179+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]: dispatch 2024-09-21T05:22:10.794 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:10 smithi110 bash[22020]: audit 2024-09-21T05:22:09.596169+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]': finished 2024-09-21T05:22:10.794 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:10 smithi110 bash[22020]: cluster 2024-09-21T05:22:09.604110+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-21T05:22:10.794 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:10 smithi110 bash[22020]: audit 2024-09-21T05:22:09.922490+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]: dispatch 2024-09-21T05:22:10.794 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:10 smithi110 bash[22020]: audit 2024-09-21T05:22:10.332323+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[19831]: audit 2024-09-21T05:22:09.596169+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]': finished 2024-09-21T05:22:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[19831]: cluster 2024-09-21T05:22:09.604110+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[19831]: audit 2024-09-21T05:22:09.922490+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]: dispatch 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[19831]: audit 2024-09-21T05:22:10.332323+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[26514]: audit 2024-09-21T05:22:09.596169+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.89:0/2179381950' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/988284848"}]': finished 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[26514]: cluster 2024-09-21T05:22:09.604110+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[26514]: audit 2024-09-21T05:22:09.922490+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]: dispatch 2024-09-21T05:22:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:10 smithi089 bash[26514]: audit 2024-09-21T05:22:10.332323+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.288Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.289Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.290Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.290Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:22:11.493 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[53567]: ts=2024-09-21T05:22:11.290Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:22:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[22020]: cluster 2024-09-21T05:22:10.535125+0000 mgr.x (mgr.24511) 28 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[22020]: audit 2024-09-21T05:22:10.614372+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]': finished 2024-09-21T05:22:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[22020]: cluster 2024-09-21T05:22:10.623593+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-21T05:22:11.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[22020]: audit 2024-09-21T05:22:10.950259+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]: dispatch 2024-09-21T05:22:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[19831]: cluster 2024-09-21T05:22:10.535125+0000 mgr.x (mgr.24511) 28 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[19831]: audit 2024-09-21T05:22:10.614372+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]': finished 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[19831]: cluster 2024-09-21T05:22:10.623593+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[19831]: audit 2024-09-21T05:22:10.950259+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]: dispatch 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[26514]: cluster 2024-09-21T05:22:10.535125+0000 mgr.x (mgr.24511) 28 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[26514]: audit 2024-09-21T05:22:10.614372+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? 172.21.15.89:0/3975418138' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6801/2041644440"}]': finished 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[26514]: cluster 2024-09-21T05:22:10.623593+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-09-21T05:22:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:11 smithi089 bash[26514]: audit 2024-09-21T05:22:10.950259+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]: dispatch 2024-09-21T05:22:12.126 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:11 smithi110 bash[54846]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:22:12.126 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[54907]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:22:12.127 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:12 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:22:12.127 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:12 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:22:12.127 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:12 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:11.616767+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]': finished 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: cluster 2024-09-21T05:22:11.624456+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:11.948824+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.89:0/682959165' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:11.949822+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.056462+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.068620+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.074747+0000 mon.c (mon.2) 205 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.076464+0000 mgr.x (mgr.24511) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.080741+0000 mon.c (mon.2) 206 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.082150+0000 mgr.x (mgr.24511) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.087739+0000 mon.c (mon.2) 207 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[19831]: audit 2024-09-21T05:22:12.089308+0000 mgr.x (mgr.24511) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:11.616767+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]': finished 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: cluster 2024-09-21T05:22:11.624456+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:11.948824+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.89:0/682959165' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:11.949822+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.056462+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.068620+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.074747+0000 mon.c (mon.2) 205 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.076464+0000 mgr.x (mgr.24511) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.080741+0000 mon.c (mon.2) 206 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.082150+0000 mgr.x (mgr.24511) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.087739+0000 mon.c (mon.2) 207 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:12 smithi089 bash[26514]: audit 2024-09-21T05:22:12.089308+0000 mgr.x (mgr.24511) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:11.616767+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.89:0/1586650679' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:6800/2041644440"}]': finished 2024-09-21T05:22:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: cluster 2024-09-21T05:22:11.624456+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-09-21T05:22:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:11.948824+0000 mon.c (mon.2) 204 : audit [INF] from='client.? 172.21.15.89:0/682959165' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:11.949822+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.056462+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.068620+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.074747+0000 mon.c (mon.2) 205 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.076464+0000 mgr.x (mgr.24511) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.080741+0000 mon.c (mon.2) 206 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.082150+0000 mgr.x (mgr.24511) 30 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.087739+0000 mon.c (mon.2) 207 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:12 smithi110 bash[22020]: audit 2024-09-21T05:22:12.089308+0000 mgr.x (mgr.24511) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:22:13.554 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.270Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.270Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.270Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.270Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.270Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.272Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.272Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.274Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.274Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.276Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.277Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=909.269µs 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.277Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.277Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-09-21T05:22:13.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.290Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.295Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.298Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.298Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.298Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=34.602µs wal_replay_duration=21.474516ms wbl_replay_duration=119ns total_replay_duration=22.445801ms 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.300Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.300Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.300Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.324Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.839888ms db_storage=1.041µs remote_storage=1.332µs web_handler=458ns query_engine=662ns scrape=244.138µs scrape_sd=180.893µs notify=17.05µs notify_sd=16.348µs rules=22.978361ms tracing=6.009µs 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.324Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:22:13.556 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[54935]: ts=2024-09-21T05:22:13.324Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:22:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[19831]: cluster 2024-09-21T05:22:12.535805+0000 mgr.x (mgr.24511) 32 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[19831]: audit 2024-09-21T05:22:12.637187+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]': finished 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[19831]: cluster 2024-09-21T05:22:12.643372+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[19831]: audit 2024-09-21T05:22:12.939123+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]: dispatch 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[26514]: cluster 2024-09-21T05:22:12.535805+0000 mgr.x (mgr.24511) 32 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[26514]: audit 2024-09-21T05:22:12.637187+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]': finished 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[26514]: cluster 2024-09-21T05:22:12.643372+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-21T05:22:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:13 smithi089 bash[26514]: audit 2024-09-21T05:22:12.939123+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]: dispatch 2024-09-21T05:22:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[22020]: cluster 2024-09-21T05:22:12.535805+0000 mgr.x (mgr.24511) 32 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[22020]: audit 2024-09-21T05:22:12.637187+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/2508932874"}]': finished 2024-09-21T05:22:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[22020]: cluster 2024-09-21T05:22:12.643372+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-09-21T05:22:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:13 smithi110 bash[22020]: audit 2024-09-21T05:22:12.939123+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]: dispatch 2024-09-21T05:22:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:14 smithi089 bash[19831]: audit 2024-09-21T05:22:13.648718+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]': finished 2024-09-21T05:22:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:14 smithi089 bash[19831]: cluster 2024-09-21T05:22:13.653613+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-21T05:22:15.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:14 smithi089 bash[26514]: audit 2024-09-21T05:22:13.648718+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]': finished 2024-09-21T05:22:15.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:14 smithi089 bash[26514]: cluster 2024-09-21T05:22:13.653613+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-21T05:22:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:14 smithi110 bash[22020]: audit 2024-09-21T05:22:13.648718+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? 172.21.15.89:0/1326287076' entity='client.iscsi.foo.smithi089.vkfkma' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.89:0/3120820653"}]': finished 2024-09-21T05:22:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:14 smithi110 bash[22020]: cluster 2024-09-21T05:22:13.653613+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-09-21T05:22:16.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:15 smithi089 bash[19831]: cluster 2024-09-21T05:22:14.536534+0000 mgr.x (mgr.24511) 33 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:15 smithi089 bash[26514]: cluster 2024-09-21T05:22:14.536534+0000 mgr.x (mgr.24511) 33 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:16.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:15 smithi110 bash[22020]: cluster 2024-09-21T05:22:14.536534+0000 mgr.x (mgr.24511) 33 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T05:22:17.957 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:17 smithi089 bash[19831]: cluster 2024-09-21T05:22:16.538189+0000 mgr.x (mgr.24511) 34 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-09-21T05:22:17.957 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:17 smithi089 bash[26514]: cluster 2024-09-21T05:22:16.538189+0000 mgr.x (mgr.24511) 34 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-09-21T05:22:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:17 smithi110 bash[22020]: cluster 2024-09-21T05:22:16.538189+0000 mgr.x (mgr.24511) 34 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 864 B/s rd, 0 op/s 2024-09-21T05:22:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:17.958792+0000 mgr.x (mgr.24511) 35 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.045095+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.052991+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.220758+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.237193+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.241818+0000 mon.c (mon.2) 208 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.243096+0000 mon.c (mon.2) 209 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[19831]: audit 2024-09-21T05:22:18.254411+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:17.958792+0000 mgr.x (mgr.24511) 35 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.045095+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.052991+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.220758+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.237193+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.241818+0000 mon.c (mon.2) 208 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:19.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.243096+0000 mon.c (mon.2) 209 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:19.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:19 smithi089 bash[26514]: audit 2024-09-21T05:22:18.254411+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:17.958792+0000 mgr.x (mgr.24511) 35 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.045095+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.052991+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.220758+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.237193+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.241818+0000 mon.c (mon.2) 208 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.243096+0000 mon.c (mon.2) 209 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:22:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:19 smithi110 bash[22020]: audit 2024-09-21T05:22:18.254411+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:22:20.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:20 smithi089 bash[19831]: cluster 2024-09-21T05:22:18.538932+0000 mgr.x (mgr.24511) 36 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-21T05:22:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:20 smithi089 bash[26514]: cluster 2024-09-21T05:22:18.538932+0000 mgr.x (mgr.24511) 36 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-21T05:22:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:20 smithi110 bash[22020]: cluster 2024-09-21T05:22:18.538932+0000 mgr.x (mgr.24511) 36 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-09-21T05:22:22.259 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:22:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:22:21] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:22:22.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:22 smithi089 bash[19831]: cluster 2024-09-21T05:22:20.539745+0000 mgr.x (mgr.24511) 37 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:22.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:22 smithi089 bash[26514]: cluster 2024-09-21T05:22:20.539745+0000 mgr.x (mgr.24511) 37 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:22.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:22 smithi110 bash[22020]: cluster 2024-09-21T05:22:20.539745+0000 mgr.x (mgr.24511) 37 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:22:24.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:24 smithi089 bash[19831]: cluster 2024-09-21T05:22:22.541397+0000 mgr.x (mgr.24511) 38 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:22:24.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:24 smithi089 bash[26514]: cluster 2024-09-21T05:22:22.541397+0000 mgr.x (mgr.24511) 38 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:22:24.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:24 smithi110 bash[22020]: cluster 2024-09-21T05:22:22.541397+0000 mgr.x (mgr.24511) 38 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:22:26.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:26 smithi089 bash[19831]: cluster 2024-09-21T05:22:24.542109+0000 mgr.x (mgr.24511) 39 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-09-21T05:22:26.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:26 smithi089 bash[19831]: audit 2024-09-21T05:22:25.332920+0000 mon.c (mon.2) 210 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:26.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:26 smithi089 bash[26514]: cluster 2024-09-21T05:22:24.542109+0000 mgr.x (mgr.24511) 39 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-09-21T05:22:26.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:26 smithi089 bash[26514]: audit 2024-09-21T05:22:25.332920+0000 mon.c (mon.2) 210 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:26.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:26 smithi110 bash[22020]: cluster 2024-09-21T05:22:24.542109+0000 mgr.x (mgr.24511) 39 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-09-21T05:22:26.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:26 smithi110 bash[22020]: audit 2024-09-21T05:22:25.332920+0000 mon.c (mon.2) 210 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:28.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:28 smithi089 bash[19831]: cluster 2024-09-21T05:22:26.543900+0000 mgr.x (mgr.24511) 40 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:28.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:28 smithi089 bash[26514]: cluster 2024-09-21T05:22:26.543900+0000 mgr.x (mgr.24511) 40 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:28.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:28 smithi110 bash[22020]: cluster 2024-09-21T05:22:26.543900+0000 mgr.x (mgr.24511) 40 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:29.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:29 smithi089 bash[19831]: audit 2024-09-21T05:22:27.969854+0000 mgr.x (mgr.24511) 41 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:29.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:29 smithi089 bash[26514]: audit 2024-09-21T05:22:27.969854+0000 mgr.x (mgr.24511) 41 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:29.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:29 smithi110 bash[22020]: audit 2024-09-21T05:22:27.969854+0000 mgr.x (mgr.24511) 41 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:30.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:30 smithi089 bash[19831]: cluster 2024-09-21T05:22:28.544788+0000 mgr.x (mgr.24511) 42 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:30.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:30 smithi089 bash[26514]: cluster 2024-09-21T05:22:28.544788+0000 mgr.x (mgr.24511) 42 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:30.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:30 smithi110 bash[22020]: cluster 2024-09-21T05:22:28.544788+0000 mgr.x (mgr.24511) 42 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:32.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:22:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:22:31] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:22:32.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:32 smithi089 bash[19831]: cluster 2024-09-21T05:22:30.545661+0000 mgr.x (mgr.24511) 43 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:32.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:32 smithi089 bash[26514]: cluster 2024-09-21T05:22:30.545661+0000 mgr.x (mgr.24511) 43 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:32.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:32 smithi110 bash[22020]: cluster 2024-09-21T05:22:30.545661+0000 mgr.x (mgr.24511) 43 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:34.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:34 smithi089 bash[19831]: cluster 2024-09-21T05:22:32.547438+0000 mgr.x (mgr.24511) 44 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:34.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:34 smithi089 bash[26514]: cluster 2024-09-21T05:22:32.547438+0000 mgr.x (mgr.24511) 44 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:34.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:34 smithi110 bash[22020]: cluster 2024-09-21T05:22:32.547438+0000 mgr.x (mgr.24511) 44 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:36.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:36 smithi110 bash[22020]: cluster 2024-09-21T05:22:34.548278+0000 mgr.x (mgr.24511) 45 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:36 smithi089 bash[19831]: cluster 2024-09-21T05:22:34.548278+0000 mgr.x (mgr.24511) 45 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:36 smithi089 bash[26514]: cluster 2024-09-21T05:22:34.548278+0000 mgr.x (mgr.24511) 45 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:38 smithi089 bash[19831]: cluster 2024-09-21T05:22:36.549949+0000 mgr.x (mgr.24511) 46 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:38 smithi089 bash[26514]: cluster 2024-09-21T05:22:36.549949+0000 mgr.x (mgr.24511) 46 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:38 smithi110 bash[22020]: cluster 2024-09-21T05:22:36.549949+0000 mgr.x (mgr.24511) 46 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:39.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:39 smithi089 bash[19831]: audit 2024-09-21T05:22:37.979127+0000 mgr.x (mgr.24511) 47 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:39 smithi089 bash[26514]: audit 2024-09-21T05:22:37.979127+0000 mgr.x (mgr.24511) 47 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:39 smithi110 bash[22020]: audit 2024-09-21T05:22:37.979127+0000 mgr.x (mgr.24511) 47 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:40 smithi089 bash[19831]: cluster 2024-09-21T05:22:38.550709+0000 mgr.x (mgr.24511) 48 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:40 smithi089 bash[26514]: cluster 2024-09-21T05:22:38.550709+0000 mgr.x (mgr.24511) 48 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:40 smithi110 bash[22020]: cluster 2024-09-21T05:22:38.550709+0000 mgr.x (mgr.24511) 48 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:41 smithi089 bash[19831]: audit 2024-09-21T05:22:40.333300+0000 mon.c (mon.2) 211 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:41 smithi089 bash[26514]: audit 2024-09-21T05:22:40.333300+0000 mon.c (mon.2) 211 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:41 smithi110 bash[22020]: audit 2024-09-21T05:22:40.333300+0000 mon.c (mon.2) 211 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:42.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:22:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:22:41] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:22:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:42 smithi089 bash[19831]: cluster 2024-09-21T05:22:40.551432+0000 mgr.x (mgr.24511) 49 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:42 smithi089 bash[26514]: cluster 2024-09-21T05:22:40.551432+0000 mgr.x (mgr.24511) 49 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:42 smithi110 bash[22020]: cluster 2024-09-21T05:22:40.551432+0000 mgr.x (mgr.24511) 49 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:44.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:44 smithi089 bash[19831]: cluster 2024-09-21T05:22:42.553107+0000 mgr.x (mgr.24511) 50 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:44.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:44 smithi089 bash[26514]: cluster 2024-09-21T05:22:42.553107+0000 mgr.x (mgr.24511) 50 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:44 smithi110 bash[22020]: cluster 2024-09-21T05:22:42.553107+0000 mgr.x (mgr.24511) 50 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:22:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:46 smithi089 bash[19831]: cluster 2024-09-21T05:22:44.553821+0000 mgr.x (mgr.24511) 51 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:46 smithi089 bash[26514]: cluster 2024-09-21T05:22:44.553821+0000 mgr.x (mgr.24511) 51 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:46 smithi110 bash[22020]: cluster 2024-09-21T05:22:44.553821+0000 mgr.x (mgr.24511) 51 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:22:48.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:48 smithi089 bash[19831]: cluster 2024-09-21T05:22:46.555483+0000 mgr.x (mgr.24511) 52 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:48.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:48 smithi089 bash[26514]: cluster 2024-09-21T05:22:46.555483+0000 mgr.x (mgr.24511) 52 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:48 smithi110 bash[22020]: cluster 2024-09-21T05:22:46.555483+0000 mgr.x (mgr.24511) 52 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:49 smithi089 bash[19831]: audit 2024-09-21T05:22:47.987115+0000 mgr.x (mgr.24511) 53 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:49.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:49 smithi089 bash[26514]: audit 2024-09-21T05:22:47.987115+0000 mgr.x (mgr.24511) 53 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:49 smithi110 bash[22020]: audit 2024-09-21T05:22:47.987115+0000 mgr.x (mgr.24511) 53 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:50 smithi089 bash[19831]: cluster 2024-09-21T05:22:48.556185+0000 mgr.x (mgr.24511) 54 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:50 smithi089 bash[26514]: cluster 2024-09-21T05:22:48.556185+0000 mgr.x (mgr.24511) 54 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:50 smithi110 bash[22020]: cluster 2024-09-21T05:22:48.556185+0000 mgr.x (mgr.24511) 54 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:52.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:22:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:22:51] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:22:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:52 smithi089 bash[19831]: cluster 2024-09-21T05:22:50.557038+0000 mgr.x (mgr.24511) 55 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:52 smithi089 bash[26514]: cluster 2024-09-21T05:22:50.557038+0000 mgr.x (mgr.24511) 55 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:52 smithi110 bash[22020]: cluster 2024-09-21T05:22:50.557038+0000 mgr.x (mgr.24511) 55 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:22:54.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:54 smithi089 bash[19831]: cluster 2024-09-21T05:22:52.558722+0000 mgr.x (mgr.24511) 56 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:54 smithi089 bash[26514]: cluster 2024-09-21T05:22:52.558722+0000 mgr.x (mgr.24511) 56 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:54 smithi110 bash[22020]: cluster 2024-09-21T05:22:52.558722+0000 mgr.x (mgr.24511) 56 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:55.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:55 smithi089 bash[19831]: audit 2024-09-21T05:22:55.336730+0000 mon.c (mon.2) 212 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:55.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:55 smithi089 bash[26514]: audit 2024-09-21T05:22:55.336730+0000 mon.c (mon.2) 212 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:55 smithi110 bash[22020]: audit 2024-09-21T05:22:55.336730+0000 mon.c (mon.2) 212 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:22:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:56 smithi089 bash[19831]: cluster 2024-09-21T05:22:54.559603+0000 mgr.x (mgr.24511) 57 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:22:56.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:56 smithi089 bash[26514]: cluster 2024-09-21T05:22:54.559603+0000 mgr.x (mgr.24511) 57 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:22:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:56 smithi110 bash[22020]: cluster 2024-09-21T05:22:54.559603+0000 mgr.x (mgr.24511) 57 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:22:58.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:58 smithi089 bash[19831]: cluster 2024-09-21T05:22:56.561448+0000 mgr.x (mgr.24511) 58 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:58 smithi089 bash[26514]: cluster 2024-09-21T05:22:56.561448+0000 mgr.x (mgr.24511) 58 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:58 smithi110 bash[22020]: cluster 2024-09-21T05:22:56.561448+0000 mgr.x (mgr.24511) 58 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:22:59.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:22:59 smithi089 bash[19831]: audit 2024-09-21T05:22:57.995256+0000 mgr.x (mgr.24511) 59 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:59.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:22:59 smithi089 bash[26514]: audit 2024-09-21T05:22:57.995256+0000 mgr.x (mgr.24511) 59 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:22:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:22:59 smithi110 bash[22020]: audit 2024-09-21T05:22:57.995256+0000 mgr.x (mgr.24511) 59 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:00 smithi089 bash[19831]: cluster 2024-09-21T05:22:58.562146+0000 mgr.x (mgr.24511) 60 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:00 smithi089 bash[26514]: cluster 2024-09-21T05:22:58.562146+0000 mgr.x (mgr.24511) 60 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:00 smithi110 bash[22020]: cluster 2024-09-21T05:22:58.562146+0000 mgr.x (mgr.24511) 60 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:02.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:01] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:23:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:02 smithi089 bash[19831]: cluster 2024-09-21T05:23:00.563079+0000 mgr.x (mgr.24511) 61 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:02 smithi089 bash[26514]: cluster 2024-09-21T05:23:00.563079+0000 mgr.x (mgr.24511) 61 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:02 smithi110 bash[22020]: cluster 2024-09-21T05:23:00.563079+0000 mgr.x (mgr.24511) 61 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:04.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:04 smithi089 bash[19831]: cluster 2024-09-21T05:23:02.564608+0000 mgr.x (mgr.24511) 62 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:04.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:04 smithi089 bash[26514]: cluster 2024-09-21T05:23:02.564608+0000 mgr.x (mgr.24511) 62 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:04 smithi110 bash[22020]: cluster 2024-09-21T05:23:02.564608+0000 mgr.x (mgr.24511) 62 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:23:06.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:06 smithi089 bash[19831]: cluster 2024-09-21T05:23:04.565323+0000 mgr.x (mgr.24511) 63 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:06 smithi089 bash[26514]: cluster 2024-09-21T05:23:04.565323+0000 mgr.x (mgr.24511) 63 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:06 smithi110 bash[22020]: cluster 2024-09-21T05:23:04.565323+0000 mgr.x (mgr.24511) 63 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:08 smithi089 bash[19831]: cluster 2024-09-21T05:23:06.566955+0000 mgr.x (mgr.24511) 64 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:08 smithi089 bash[26514]: cluster 2024-09-21T05:23:06.566955+0000 mgr.x (mgr.24511) 64 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:08 smithi110 bash[22020]: cluster 2024-09-21T05:23:06.566955+0000 mgr.x (mgr.24511) 64 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:09 smithi089 bash[19831]: audit 2024-09-21T05:23:08.001809+0000 mgr.x (mgr.24511) 65 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:09 smithi089 bash[26514]: audit 2024-09-21T05:23:08.001809+0000 mgr.x (mgr.24511) 65 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:09 smithi110 bash[22020]: audit 2024-09-21T05:23:08.001809+0000 mgr.x (mgr.24511) 65 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:10 smithi089 bash[26514]: cluster 2024-09-21T05:23:08.567704+0000 mgr.x (mgr.24511) 66 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:10 smithi089 bash[26514]: audit 2024-09-21T05:23:10.336964+0000 mon.c (mon.2) 213 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:10 smithi089 bash[19831]: cluster 2024-09-21T05:23:08.567704+0000 mgr.x (mgr.24511) 66 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:10 smithi089 bash[19831]: audit 2024-09-21T05:23:10.336964+0000 mon.c (mon.2) 213 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:10 smithi110 bash[22020]: cluster 2024-09-21T05:23:08.567704+0000 mgr.x (mgr.24511) 66 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:10 smithi110 bash[22020]: audit 2024-09-21T05:23:10.336964+0000 mon.c (mon.2) 213 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:12.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:11] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:23:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:12 smithi089 bash[19831]: cluster 2024-09-21T05:23:10.568999+0000 mgr.x (mgr.24511) 67 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:12 smithi089 bash[26514]: cluster 2024-09-21T05:23:10.568999+0000 mgr.x (mgr.24511) 67 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:12 smithi110 bash[22020]: cluster 2024-09-21T05:23:10.568999+0000 mgr.x (mgr.24511) 67 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:14.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:14 smithi089 bash[19831]: cluster 2024-09-21T05:23:12.570098+0000 mgr.x (mgr.24511) 68 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:14 smithi089 bash[26514]: cluster 2024-09-21T05:23:12.570098+0000 mgr.x (mgr.24511) 68 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:14 smithi110 bash[22020]: cluster 2024-09-21T05:23:12.570098+0000 mgr.x (mgr.24511) 68 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:16.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:16 smithi089 bash[19831]: cluster 2024-09-21T05:23:14.570809+0000 mgr.x (mgr.24511) 69 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:16.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:16 smithi089 bash[26514]: cluster 2024-09-21T05:23:14.570809+0000 mgr.x (mgr.24511) 69 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:16 smithi110 bash[22020]: cluster 2024-09-21T05:23:14.570809+0000 mgr.x (mgr.24511) 69 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:18 smithi089 bash[26514]: cluster 2024-09-21T05:23:16.572472+0000 mgr.x (mgr.24511) 70 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:18 smithi089 bash[19831]: cluster 2024-09-21T05:23:16.572472+0000 mgr.x (mgr.24511) 70 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:18 smithi110 bash[22020]: cluster 2024-09-21T05:23:16.572472+0000 mgr.x (mgr.24511) 70 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[19831]: audit 2024-09-21T05:23:18.011424+0000 mgr.x (mgr.24511) 71 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[19831]: audit 2024-09-21T05:23:18.937232+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[19831]: audit 2024-09-21T05:23:18.946304+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[26514]: audit 2024-09-21T05:23:18.011424+0000 mgr.x (mgr.24511) 71 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[26514]: audit 2024-09-21T05:23:18.937232+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:19 smithi089 bash[26514]: audit 2024-09-21T05:23:18.946304+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:19 smithi110 bash[22020]: audit 2024-09-21T05:23:18.011424+0000 mgr.x (mgr.24511) 71 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:19 smithi110 bash[22020]: audit 2024-09-21T05:23:18.937232+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:19 smithi110 bash[22020]: audit 2024-09-21T05:23:18.946304+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[19831]: cluster 2024-09-21T05:23:18.573146+0000 mgr.x (mgr.24511) 72 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[19831]: audit 2024-09-21T05:23:19.577798+0000 mon.c (mon.2) 214 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[19831]: audit 2024-09-21T05:23:19.579130+0000 mon.c (mon.2) 215 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[19831]: audit 2024-09-21T05:23:19.588357+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[26514]: cluster 2024-09-21T05:23:18.573146+0000 mgr.x (mgr.24511) 72 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[26514]: audit 2024-09-21T05:23:19.577798+0000 mon.c (mon.2) 214 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[26514]: audit 2024-09-21T05:23:19.579130+0000 mon.c (mon.2) 215 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:20.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:20 smithi089 bash[26514]: audit 2024-09-21T05:23:19.588357+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:20 smithi110 bash[22020]: cluster 2024-09-21T05:23:18.573146+0000 mgr.x (mgr.24511) 72 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:20 smithi110 bash[22020]: audit 2024-09-21T05:23:19.577798+0000 mon.c (mon.2) 214 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:23:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:20 smithi110 bash[22020]: audit 2024-09-21T05:23:19.579130+0000 mon.c (mon.2) 215 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:23:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:20 smithi110 bash[22020]: audit 2024-09-21T05:23:19.588357+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:23:21.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:21 smithi089 bash[19831]: cluster 2024-09-21T05:23:20.574697+0000 mgr.x (mgr.24511) 73 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:21.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:21 smithi089 bash[26514]: cluster 2024-09-21T05:23:20.574697+0000 mgr.x (mgr.24511) 73 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:21 smithi110 bash[22020]: cluster 2024-09-21T05:23:20.574697+0000 mgr.x (mgr.24511) 73 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:22.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:21] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.43.0" 2024-09-21T05:23:24.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:23 smithi089 bash[19831]: cluster 2024-09-21T05:23:22.575412+0000 mgr.x (mgr.24511) 74 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:23 smithi089 bash[26514]: cluster 2024-09-21T05:23:22.575412+0000 mgr.x (mgr.24511) 74 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:23 smithi110 bash[22020]: cluster 2024-09-21T05:23:22.575412+0000 mgr.x (mgr.24511) 74 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:25 smithi089 bash[19831]: cluster 2024-09-21T05:23:24.576098+0000 mgr.x (mgr.24511) 75 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:25 smithi089 bash[19831]: audit 2024-09-21T05:23:25.337307+0000 mon.c (mon.2) 216 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:26.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:25 smithi089 bash[26514]: cluster 2024-09-21T05:23:24.576098+0000 mgr.x (mgr.24511) 75 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:26.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:25 smithi089 bash[26514]: audit 2024-09-21T05:23:25.337307+0000 mon.c (mon.2) 216 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:25 smithi110 bash[22020]: cluster 2024-09-21T05:23:24.576098+0000 mgr.x (mgr.24511) 75 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:25 smithi110 bash[22020]: audit 2024-09-21T05:23:25.337307+0000 mon.c (mon.2) 216 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:28.022 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:27 smithi089 bash[19831]: cluster 2024-09-21T05:23:26.577720+0000 mgr.x (mgr.24511) 76 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:28.023 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:27 smithi089 bash[26514]: cluster 2024-09-21T05:23:26.577720+0000 mgr.x (mgr.24511) 76 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:27 smithi110 bash[22020]: cluster 2024-09-21T05:23:26.577720+0000 mgr.x (mgr.24511) 76 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:28 smithi089 bash[19831]: audit 2024-09-21T05:23:28.022980+0000 mgr.x (mgr.24511) 77 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:28 smithi089 bash[26514]: audit 2024-09-21T05:23:28.022980+0000 mgr.x (mgr.24511) 77 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:28 smithi110 bash[22020]: audit 2024-09-21T05:23:28.022980+0000 mgr.x (mgr.24511) 77 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:29 smithi089 bash[19831]: cluster 2024-09-21T05:23:28.578402+0000 mgr.x (mgr.24511) 78 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:29 smithi089 bash[26514]: cluster 2024-09-21T05:23:28.578402+0000 mgr.x (mgr.24511) 78 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:29 smithi110 bash[22020]: cluster 2024-09-21T05:23:28.578402+0000 mgr.x (mgr.24511) 78 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:31 smithi089 bash[19831]: cluster 2024-09-21T05:23:30.580134+0000 mgr.x (mgr.24511) 79 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:31 smithi089 bash[26514]: cluster 2024-09-21T05:23:30.580134+0000 mgr.x (mgr.24511) 79 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:31 smithi110 bash[22020]: cluster 2024-09-21T05:23:30.580134+0000 mgr.x (mgr.24511) 79 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:32.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:31] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:23:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:33 smithi089 bash[19831]: cluster 2024-09-21T05:23:32.581003+0000 mgr.x (mgr.24511) 80 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:33 smithi089 bash[26514]: cluster 2024-09-21T05:23:32.581003+0000 mgr.x (mgr.24511) 80 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:34.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:33 smithi110 bash[22020]: cluster 2024-09-21T05:23:32.581003+0000 mgr.x (mgr.24511) 80 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:35 smithi089 bash[26514]: cluster 2024-09-21T05:23:34.581844+0000 mgr.x (mgr.24511) 81 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:35 smithi089 bash[19831]: cluster 2024-09-21T05:23:34.581844+0000 mgr.x (mgr.24511) 81 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:35 smithi110 bash[22020]: cluster 2024-09-21T05:23:34.581844+0000 mgr.x (mgr.24511) 81 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:38.034 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:37 smithi089 bash[19831]: cluster 2024-09-21T05:23:36.583605+0000 mgr.x (mgr.24511) 82 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:38.034 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:37 smithi089 bash[26514]: cluster 2024-09-21T05:23:36.583605+0000 mgr.x (mgr.24511) 82 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:37 smithi110 bash[22020]: cluster 2024-09-21T05:23:36.583605+0000 mgr.x (mgr.24511) 82 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:38 smithi089 bash[19831]: audit 2024-09-21T05:23:38.034416+0000 mgr.x (mgr.24511) 83 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:38 smithi089 bash[26514]: audit 2024-09-21T05:23:38.034416+0000 mgr.x (mgr.24511) 83 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:38 smithi110 bash[22020]: audit 2024-09-21T05:23:38.034416+0000 mgr.x (mgr.24511) 83 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:39 smithi089 bash[19831]: cluster 2024-09-21T05:23:38.584467+0000 mgr.x (mgr.24511) 84 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:39 smithi089 bash[26514]: cluster 2024-09-21T05:23:38.584467+0000 mgr.x (mgr.24511) 84 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:39 smithi110 bash[22020]: cluster 2024-09-21T05:23:38.584467+0000 mgr.x (mgr.24511) 84 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:40 smithi089 bash[19831]: audit 2024-09-21T05:23:40.337593+0000 mon.c (mon.2) 217 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:40 smithi089 bash[26514]: audit 2024-09-21T05:23:40.337593+0000 mon.c (mon.2) 217 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:40 smithi110 bash[22020]: audit 2024-09-21T05:23:40.337593+0000 mon.c (mon.2) 217 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:42.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:41 smithi089 bash[19831]: cluster 2024-09-21T05:23:40.586104+0000 mgr.x (mgr.24511) 85 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:42.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:41 smithi089 bash[26514]: cluster 2024-09-21T05:23:40.586104+0000 mgr.x (mgr.24511) 85 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:41 smithi110 bash[22020]: cluster 2024-09-21T05:23:40.586104+0000 mgr.x (mgr.24511) 85 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:42.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:41] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:23:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:43 smithi089 bash[19831]: cluster 2024-09-21T05:23:42.586800+0000 mgr.x (mgr.24511) 86 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:43 smithi089 bash[26514]: cluster 2024-09-21T05:23:42.586800+0000 mgr.x (mgr.24511) 86 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:43 smithi110 bash[22020]: cluster 2024-09-21T05:23:42.586800+0000 mgr.x (mgr.24511) 86 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:45 smithi089 bash[19831]: cluster 2024-09-21T05:23:44.587507+0000 mgr.x (mgr.24511) 87 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:45 smithi089 bash[26514]: cluster 2024-09-21T05:23:44.587507+0000 mgr.x (mgr.24511) 87 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:45 smithi110 bash[22020]: cluster 2024-09-21T05:23:44.587507+0000 mgr.x (mgr.24511) 87 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:48.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:47 smithi089 bash[19831]: cluster 2024-09-21T05:23:46.589165+0000 mgr.x (mgr.24511) 88 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:47 smithi089 bash[26514]: cluster 2024-09-21T05:23:46.589165+0000 mgr.x (mgr.24511) 88 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:47 smithi110 bash[22020]: cluster 2024-09-21T05:23:46.589165+0000 mgr.x (mgr.24511) 88 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:49.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:48 smithi089 bash[19831]: audit 2024-09-21T05:23:48.045963+0000 mgr.x (mgr.24511) 89 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:48 smithi089 bash[26514]: audit 2024-09-21T05:23:48.045963+0000 mgr.x (mgr.24511) 89 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:48 smithi110 bash[22020]: audit 2024-09-21T05:23:48.045963+0000 mgr.x (mgr.24511) 89 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:49 smithi089 bash[19831]: cluster 2024-09-21T05:23:48.589829+0000 mgr.x (mgr.24511) 90 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:49 smithi089 bash[26514]: cluster 2024-09-21T05:23:48.589829+0000 mgr.x (mgr.24511) 90 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:49 smithi110 bash[22020]: cluster 2024-09-21T05:23:48.589829+0000 mgr.x (mgr.24511) 90 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:51 smithi089 bash[19831]: cluster 2024-09-21T05:23:50.591380+0000 mgr.x (mgr.24511) 91 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:51 smithi089 bash[26514]: cluster 2024-09-21T05:23:50.591380+0000 mgr.x (mgr.24511) 91 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:51 smithi110 bash[22020]: cluster 2024-09-21T05:23:50.591380+0000 mgr.x (mgr.24511) 91 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:52.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:23:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:23:51] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:23:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:53 smithi089 bash[19831]: cluster 2024-09-21T05:23:52.592066+0000 mgr.x (mgr.24511) 92 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:53 smithi089 bash[26514]: cluster 2024-09-21T05:23:52.592066+0000 mgr.x (mgr.24511) 92 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:53 smithi110 bash[22020]: cluster 2024-09-21T05:23:52.592066+0000 mgr.x (mgr.24511) 92 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:55 smithi089 bash[19831]: cluster 2024-09-21T05:23:54.592699+0000 mgr.x (mgr.24511) 93 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:55 smithi089 bash[19831]: audit 2024-09-21T05:23:55.337939+0000 mon.c (mon.2) 218 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:55 smithi089 bash[26514]: cluster 2024-09-21T05:23:54.592699+0000 mgr.x (mgr.24511) 93 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:55 smithi089 bash[26514]: audit 2024-09-21T05:23:55.337939+0000 mon.c (mon.2) 218 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:55 smithi110 bash[22020]: cluster 2024-09-21T05:23:54.592699+0000 mgr.x (mgr.24511) 93 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:23:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:55 smithi110 bash[22020]: audit 2024-09-21T05:23:55.337939+0000 mon.c (mon.2) 218 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:23:58.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:58 smithi089 bash[19831]: cluster 2024-09-21T05:23:56.594382+0000 mgr.x (mgr.24511) 94 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:58.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:58 smithi089 bash[26514]: cluster 2024-09-21T05:23:56.594382+0000 mgr.x (mgr.24511) 94 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:58.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:58 smithi110 bash[22020]: cluster 2024-09-21T05:23:56.594382+0000 mgr.x (mgr.24511) 94 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:23:59.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:23:59 smithi089 bash[19831]: audit 2024-09-21T05:23:58.057556+0000 mgr.x (mgr.24511) 95 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:59.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:23:59 smithi089 bash[26514]: audit 2024-09-21T05:23:58.057556+0000 mgr.x (mgr.24511) 95 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:23:59.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:23:59 smithi110 bash[22020]: audit 2024-09-21T05:23:58.057556+0000 mgr.x (mgr.24511) 95 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:00 smithi089 bash[19831]: cluster 2024-09-21T05:23:58.595079+0000 mgr.x (mgr.24511) 96 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:00.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:00 smithi089 bash[26514]: cluster 2024-09-21T05:23:58.595079+0000 mgr.x (mgr.24511) 96 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:00 smithi110 bash[22020]: cluster 2024-09-21T05:23:58.595079+0000 mgr.x (mgr.24511) 96 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:02.195 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:01] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.43.0" 2024-09-21T05:24:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:02 smithi089 bash[19831]: cluster 2024-09-21T05:24:00.596628+0000 mgr.x (mgr.24511) 97 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:02 smithi089 bash[26514]: cluster 2024-09-21T05:24:00.596628+0000 mgr.x (mgr.24511) 97 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:02 smithi110 bash[22020]: cluster 2024-09-21T05:24:00.596628+0000 mgr.x (mgr.24511) 97 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:04.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:04 smithi089 bash[19831]: cluster 2024-09-21T05:24:02.597438+0000 mgr.x (mgr.24511) 98 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:04.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:04 smithi089 bash[26514]: cluster 2024-09-21T05:24:02.597438+0000 mgr.x (mgr.24511) 98 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:04.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:04 smithi110 bash[22020]: cluster 2024-09-21T05:24:02.597438+0000 mgr.x (mgr.24511) 98 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:06 smithi089 bash[19831]: cluster 2024-09-21T05:24:04.598164+0000 mgr.x (mgr.24511) 99 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:06 smithi089 bash[26514]: cluster 2024-09-21T05:24:04.598164+0000 mgr.x (mgr.24511) 99 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:06.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:06 smithi110 bash[22020]: cluster 2024-09-21T05:24:04.598164+0000 mgr.x (mgr.24511) 99 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:08.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:08 smithi089 bash[19831]: cluster 2024-09-21T05:24:06.599889+0000 mgr.x (mgr.24511) 100 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:08.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:08 smithi089 bash[26514]: cluster 2024-09-21T05:24:06.599889+0000 mgr.x (mgr.24511) 100 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:08.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:08 smithi110 bash[22020]: cluster 2024-09-21T05:24:06.599889+0000 mgr.x (mgr.24511) 100 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:09.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:09 smithi089 bash[19831]: audit 2024-09-21T05:24:08.069117+0000 mgr.x (mgr.24511) 101 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:09.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:09 smithi089 bash[26514]: audit 2024-09-21T05:24:08.069117+0000 mgr.x (mgr.24511) 101 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:09.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:09 smithi110 bash[22020]: audit 2024-09-21T05:24:08.069117+0000 mgr.x (mgr.24511) 101 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:10 smithi089 bash[19831]: cluster 2024-09-21T05:24:08.600722+0000 mgr.x (mgr.24511) 102 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:10.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:10 smithi089 bash[26514]: cluster 2024-09-21T05:24:08.600722+0000 mgr.x (mgr.24511) 102 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:10 smithi110 bash[22020]: cluster 2024-09-21T05:24:08.600722+0000 mgr.x (mgr.24511) 102 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:11.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:11 smithi089 bash[19831]: audit 2024-09-21T05:24:10.338467+0000 mon.c (mon.2) 219 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:11.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:11 smithi089 bash[26514]: audit 2024-09-21T05:24:10.338467+0000 mon.c (mon.2) 219 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:11.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:11 smithi110 bash[22020]: audit 2024-09-21T05:24:10.338467+0000 mon.c (mon.2) 219 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:12.233 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:11] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:24:12.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:12 smithi089 bash[19831]: cluster 2024-09-21T05:24:10.602319+0000 mgr.x (mgr.24511) 103 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:12 smithi089 bash[26514]: cluster 2024-09-21T05:24:10.602319+0000 mgr.x (mgr.24511) 103 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:12.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:12 smithi110 bash[22020]: cluster 2024-09-21T05:24:10.602319+0000 mgr.x (mgr.24511) 103 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:14 smithi089 bash[19831]: cluster 2024-09-21T05:24:12.602985+0000 mgr.x (mgr.24511) 104 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:14.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:14 smithi089 bash[26514]: cluster 2024-09-21T05:24:12.602985+0000 mgr.x (mgr.24511) 104 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:14 smithi110 bash[22020]: cluster 2024-09-21T05:24:12.602985+0000 mgr.x (mgr.24511) 104 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:16 smithi089 bash[19831]: cluster 2024-09-21T05:24:14.603673+0000 mgr.x (mgr.24511) 105 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:16 smithi089 bash[26514]: cluster 2024-09-21T05:24:14.603673+0000 mgr.x (mgr.24511) 105 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:16 smithi110 bash[22020]: cluster 2024-09-21T05:24:14.603673+0000 mgr.x (mgr.24511) 105 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:18.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:18 smithi089 bash[19831]: cluster 2024-09-21T05:24:16.605255+0000 mgr.x (mgr.24511) 106 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:18 smithi089 bash[26514]: cluster 2024-09-21T05:24:16.605255+0000 mgr.x (mgr.24511) 106 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:18 smithi110 bash[22020]: cluster 2024-09-21T05:24:16.605255+0000 mgr.x (mgr.24511) 106 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:19.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:19 smithi089 bash[19831]: audit 2024-09-21T05:24:18.080651+0000 mgr.x (mgr.24511) 107 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:19 smithi089 bash[26514]: audit 2024-09-21T05:24:18.080651+0000 mgr.x (mgr.24511) 107 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:19 smithi110 bash[22020]: audit 2024-09-21T05:24:18.080651+0000 mgr.x (mgr.24511) 107 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:20.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:20 smithi089 bash[19831]: cluster 2024-09-21T05:24:18.605938+0000 mgr.x (mgr.24511) 108 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:20.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:20 smithi089 bash[26514]: cluster 2024-09-21T05:24:18.605938+0000 mgr.x (mgr.24511) 108 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:20 smithi110 bash[22020]: cluster 2024-09-21T05:24:18.605938+0000 mgr.x (mgr.24511) 108 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:21.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[19831]: audit 2024-09-21T05:24:20.360201+0000 mon.c (mon.2) 220 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:21.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[19831]: audit 2024-09-21T05:24:20.362102+0000 mon.c (mon.2) 221 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:21.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[19831]: audit 2024-09-21T05:24:20.372644+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:24:21.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[26514]: audit 2024-09-21T05:24:20.360201+0000 mon.c (mon.2) 220 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:21.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[26514]: audit 2024-09-21T05:24:20.362102+0000 mon.c (mon.2) 221 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:21.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:21 smithi089 bash[26514]: audit 2024-09-21T05:24:20.372644+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:24:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:21 smithi110 bash[22020]: audit 2024-09-21T05:24:20.360201+0000 mon.c (mon.2) 220 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:24:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:21 smithi110 bash[22020]: audit 2024-09-21T05:24:20.362102+0000 mon.c (mon.2) 221 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:24:21.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:21 smithi110 bash[22020]: audit 2024-09-21T05:24:20.372644+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:24:22.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:21] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:24:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:22 smithi089 bash[19831]: cluster 2024-09-21T05:24:20.607443+0000 mgr.x (mgr.24511) 109 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:22 smithi089 bash[26514]: cluster 2024-09-21T05:24:20.607443+0000 mgr.x (mgr.24511) 109 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:22 smithi110 bash[22020]: cluster 2024-09-21T05:24:20.607443+0000 mgr.x (mgr.24511) 109 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:24 smithi089 bash[19831]: cluster 2024-09-21T05:24:22.608111+0000 mgr.x (mgr.24511) 110 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:24 smithi089 bash[26514]: cluster 2024-09-21T05:24:22.608111+0000 mgr.x (mgr.24511) 110 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:24 smithi110 bash[22020]: cluster 2024-09-21T05:24:22.608111+0000 mgr.x (mgr.24511) 110 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:25 smithi089 bash[19831]: audit 2024-09-21T05:24:25.338822+0000 mon.c (mon.2) 222 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:25 smithi089 bash[26514]: audit 2024-09-21T05:24:25.338822+0000 mon.c (mon.2) 222 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:25 smithi110 bash[22020]: audit 2024-09-21T05:24:25.338822+0000 mon.c (mon.2) 222 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:26 smithi089 bash[19831]: cluster 2024-09-21T05:24:24.608810+0000 mgr.x (mgr.24511) 111 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:26.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:26 smithi089 bash[26514]: cluster 2024-09-21T05:24:24.608810+0000 mgr.x (mgr.24511) 111 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:26 smithi110 bash[22020]: cluster 2024-09-21T05:24:24.608810+0000 mgr.x (mgr.24511) 111 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:28 smithi089 bash[19831]: cluster 2024-09-21T05:24:26.610450+0000 mgr.x (mgr.24511) 112 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:28 smithi089 bash[26514]: cluster 2024-09-21T05:24:26.610450+0000 mgr.x (mgr.24511) 112 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:28 smithi110 bash[22020]: cluster 2024-09-21T05:24:26.610450+0000 mgr.x (mgr.24511) 112 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:29 smithi089 bash[19831]: audit 2024-09-21T05:24:28.091655+0000 mgr.x (mgr.24511) 113 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:29 smithi089 bash[26514]: audit 2024-09-21T05:24:28.091655+0000 mgr.x (mgr.24511) 113 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:29 smithi110 bash[22020]: audit 2024-09-21T05:24:28.091655+0000 mgr.x (mgr.24511) 113 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:30 smithi089 bash[19831]: cluster 2024-09-21T05:24:28.611155+0000 mgr.x (mgr.24511) 114 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:30 smithi089 bash[26514]: cluster 2024-09-21T05:24:28.611155+0000 mgr.x (mgr.24511) 114 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:30 smithi110 bash[22020]: cluster 2024-09-21T05:24:28.611155+0000 mgr.x (mgr.24511) 114 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:32.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:31] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.43.0" 2024-09-21T05:24:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:32 smithi089 bash[19831]: cluster 2024-09-21T05:24:30.612663+0000 mgr.x (mgr.24511) 115 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:32 smithi089 bash[26514]: cluster 2024-09-21T05:24:30.612663+0000 mgr.x (mgr.24511) 115 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:32 smithi110 bash[22020]: cluster 2024-09-21T05:24:30.612663+0000 mgr.x (mgr.24511) 115 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:34.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:34 smithi089 bash[19831]: cluster 2024-09-21T05:24:32.613366+0000 mgr.x (mgr.24511) 116 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:34 smithi089 bash[26514]: cluster 2024-09-21T05:24:32.613366+0000 mgr.x (mgr.24511) 116 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:34 smithi110 bash[22020]: cluster 2024-09-21T05:24:32.613366+0000 mgr.x (mgr.24511) 116 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:36 smithi089 bash[19831]: cluster 2024-09-21T05:24:34.614060+0000 mgr.x (mgr.24511) 117 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:36 smithi089 bash[26514]: cluster 2024-09-21T05:24:34.614060+0000 mgr.x (mgr.24511) 117 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:36 smithi110 bash[22020]: cluster 2024-09-21T05:24:34.614060+0000 mgr.x (mgr.24511) 117 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:38 smithi089 bash[19831]: cluster 2024-09-21T05:24:36.615725+0000 mgr.x (mgr.24511) 118 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:38 smithi089 bash[26514]: cluster 2024-09-21T05:24:36.615725+0000 mgr.x (mgr.24511) 118 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:38 smithi110 bash[22020]: cluster 2024-09-21T05:24:36.615725+0000 mgr.x (mgr.24511) 118 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:39 smithi089 bash[19831]: audit 2024-09-21T05:24:38.094420+0000 mgr.x (mgr.24511) 119 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:39 smithi089 bash[26514]: audit 2024-09-21T05:24:38.094420+0000 mgr.x (mgr.24511) 119 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:39 smithi110 bash[22020]: audit 2024-09-21T05:24:38.094420+0000 mgr.x (mgr.24511) 119 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:40 smithi089 bash[26514]: cluster 2024-09-21T05:24:38.616445+0000 mgr.x (mgr.24511) 120 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:40 smithi089 bash[26514]: audit 2024-09-21T05:24:40.339123+0000 mon.c (mon.2) 223 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:40 smithi089 bash[19831]: cluster 2024-09-21T05:24:38.616445+0000 mgr.x (mgr.24511) 120 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:40 smithi089 bash[19831]: audit 2024-09-21T05:24:40.339123+0000 mon.c (mon.2) 223 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:40 smithi110 bash[22020]: cluster 2024-09-21T05:24:38.616445+0000 mgr.x (mgr.24511) 120 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:40 smithi110 bash[22020]: audit 2024-09-21T05:24:40.339123+0000 mon.c (mon.2) 223 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:42.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:41] "GET /metrics HTTP/1.1" 200 38242 "" "Prometheus/2.43.0" 2024-09-21T05:24:42.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:42 smithi089 bash[19831]: cluster 2024-09-21T05:24:40.618043+0000 mgr.x (mgr.24511) 121 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:42 smithi089 bash[26514]: cluster 2024-09-21T05:24:40.618043+0000 mgr.x (mgr.24511) 121 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:42 smithi110 bash[22020]: cluster 2024-09-21T05:24:40.618043+0000 mgr.x (mgr.24511) 121 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:44.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:44 smithi089 bash[19831]: cluster 2024-09-21T05:24:42.618748+0000 mgr.x (mgr.24511) 122 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:44.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:44 smithi089 bash[26514]: cluster 2024-09-21T05:24:42.618748+0000 mgr.x (mgr.24511) 122 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:44 smithi110 bash[22020]: cluster 2024-09-21T05:24:42.618748+0000 mgr.x (mgr.24511) 122 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:46.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:46 smithi089 bash[19831]: cluster 2024-09-21T05:24:44.619477+0000 mgr.x (mgr.24511) 123 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:46 smithi089 bash[26514]: cluster 2024-09-21T05:24:44.619477+0000 mgr.x (mgr.24511) 123 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:46 smithi110 bash[22020]: cluster 2024-09-21T05:24:44.619477+0000 mgr.x (mgr.24511) 123 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:48 smithi089 bash[19831]: cluster 2024-09-21T05:24:46.621211+0000 mgr.x (mgr.24511) 124 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:48 smithi089 bash[26514]: cluster 2024-09-21T05:24:46.621211+0000 mgr.x (mgr.24511) 124 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:48 smithi110 bash[22020]: cluster 2024-09-21T05:24:46.621211+0000 mgr.x (mgr.24511) 124 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:49 smithi089 bash[19831]: audit 2024-09-21T05:24:48.105928+0000 mgr.x (mgr.24511) 125 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:49.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:49 smithi089 bash[26514]: audit 2024-09-21T05:24:48.105928+0000 mgr.x (mgr.24511) 125 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:49 smithi110 bash[22020]: audit 2024-09-21T05:24:48.105928+0000 mgr.x (mgr.24511) 125 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:50 smithi089 bash[26514]: cluster 2024-09-21T05:24:48.622034+0000 mgr.x (mgr.24511) 126 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:50 smithi089 bash[19831]: cluster 2024-09-21T05:24:48.622034+0000 mgr.x (mgr.24511) 126 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:50 smithi110 bash[22020]: cluster 2024-09-21T05:24:48.622034+0000 mgr.x (mgr.24511) 126 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:52.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:24:51 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:24:51] "GET /metrics HTTP/1.1" 200 38242 "" "Prometheus/2.43.0" 2024-09-21T05:24:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:52 smithi089 bash[19831]: cluster 2024-09-21T05:24:50.623637+0000 mgr.x (mgr.24511) 127 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:52 smithi089 bash[26514]: cluster 2024-09-21T05:24:50.623637+0000 mgr.x (mgr.24511) 127 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:52 smithi110 bash[22020]: cluster 2024-09-21T05:24:50.623637+0000 mgr.x (mgr.24511) 127 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:53.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:53 smithi089 bash[19831]: cluster 2024-09-21T05:24:52.624434+0000 mgr.x (mgr.24511) 128 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:53.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:53 smithi089 bash[26514]: cluster 2024-09-21T05:24:52.624434+0000 mgr.x (mgr.24511) 128 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:53.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:53 smithi110 bash[22020]: cluster 2024-09-21T05:24:52.624434+0000 mgr.x (mgr.24511) 128 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:55 smithi089 bash[19831]: cluster 2024-09-21T05:24:54.625274+0000 mgr.x (mgr.24511) 129 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:55 smithi089 bash[19831]: audit 2024-09-21T05:24:55.339430+0000 mon.c (mon.2) 224 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:55 smithi089 bash[26514]: cluster 2024-09-21T05:24:54.625274+0000 mgr.x (mgr.24511) 129 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:55 smithi089 bash[26514]: audit 2024-09-21T05:24:55.339430+0000 mon.c (mon.2) 224 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:55 smithi110 bash[22020]: cluster 2024-09-21T05:24:54.625274+0000 mgr.x (mgr.24511) 129 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:24:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:55 smithi110 bash[22020]: audit 2024-09-21T05:24:55.339430+0000 mon.c (mon.2) 224 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:24:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:57 smithi089 bash[19831]: cluster 2024-09-21T05:24:56.627053+0000 mgr.x (mgr.24511) 130 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:57 smithi089 bash[26514]: cluster 2024-09-21T05:24:56.627053+0000 mgr.x (mgr.24511) 130 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:58.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:57 smithi110 bash[22020]: cluster 2024-09-21T05:24:56.627053+0000 mgr.x (mgr.24511) 130 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:24:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:58 smithi089 bash[19831]: audit 2024-09-21T05:24:58.114913+0000 mgr.x (mgr.24511) 131 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:58 smithi089 bash[26514]: audit 2024-09-21T05:24:58.114913+0000 mgr.x (mgr.24511) 131 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:24:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:58 smithi110 bash[22020]: audit 2024-09-21T05:24:58.114913+0000 mgr.x (mgr.24511) 131 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:24:59 smithi089 bash[19831]: cluster 2024-09-21T05:24:58.627911+0000 mgr.x (mgr.24511) 132 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:24:59 smithi089 bash[26514]: cluster 2024-09-21T05:24:58.627911+0000 mgr.x (mgr.24511) 132 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:24:59 smithi110 bash[22020]: cluster 2024-09-21T05:24:58.627911+0000 mgr.x (mgr.24511) 132 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:01.964 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:01 smithi110 bash[22020]: cluster 2024-09-21T05:25:00.629501+0000 mgr.x (mgr.24511) 133 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:01.964 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:01 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:25:01] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:25:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:01 smithi089 bash[26514]: cluster 2024-09-21T05:25:00.629501+0000 mgr.x (mgr.24511) 133 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:01 smithi089 bash[19831]: cluster 2024-09-21T05:25:00.629501+0000 mgr.x (mgr.24511) 133 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:02.083 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:25:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:03 smithi089 bash[26514]: cluster 2024-09-21T05:25:02.630241+0000 mgr.x (mgr.24511) 134 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:04.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:03 smithi089 bash[19831]: cluster 2024-09-21T05:25:02.630241+0000 mgr.x (mgr.24511) 134 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:04.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:03 smithi110 bash[22020]: cluster 2024-09-21T05:25:02.630241+0000 mgr.x (mgr.24511) 134 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:05 smithi089 bash[19831]: cluster 2024-09-21T05:25:04.630940+0000 mgr.x (mgr.24511) 135 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:05 smithi089 bash[26514]: cluster 2024-09-21T05:25:04.630940+0000 mgr.x (mgr.24511) 135 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:05 smithi110 bash[22020]: cluster 2024-09-21T05:25:04.630940+0000 mgr.x (mgr.24511) 135 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:06.900 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:25:07.974 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:07 smithi089 bash[19831]: cluster 2024-09-21T05:25:06.632611+0000 mgr.x (mgr.24511) 136 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:07.974 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:07 smithi089 bash[26514]: cluster 2024-09-21T05:25:06.632611+0000 mgr.x (mgr.24511) 136 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:07 smithi110 bash[22020]: cluster 2024-09-21T05:25:06.632611+0000 mgr.x (mgr.24511) 136 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:08.345 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:25:08.345 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (24m) 2m ago 24m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:25:08.345 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (24m) 2m ago 24m 76.0M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:25:08.345 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (3m) 2m ago 22m 46.8M - 3.8 164465d2334a a56b06f0989a 2024-09-21T05:25:08.345 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (17m) 2m ago 32m 495M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (9m) 2m ago 35m 438M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (35m) 2m ago 35m 79.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (33m) 2m ago 33m 58.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (33m) 2m ago 33m 60.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (24m) 2m ago 24m 9111k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (24m) 2m ago 24m 8775k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (32m) 2m ago 32m 56.7M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (31m) 2m ago 31m 65.8M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (30m) 2m ago 30m 61.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (29m) 2m ago 29m 56.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (28m) 2m ago 28m 70.6M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (27m) 2m ago 27m 54.5M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (26m) 2m ago 26m 62.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:25:08.346 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (25m) 2m ago 25m 63.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:25:08.347 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (2m) 2m ago 25m 31.1M - 2.43.0 a07b618ecd1d 4c31f909b570 2024-09-21T05:25:08.347 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (22m) 2m ago 22m 101M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:25:08.347 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (22m) 2m ago 22m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:25:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:08 smithi089 bash[19831]: audit 2024-09-21T05:25:08.123565+0000 mgr.x (mgr.24511) 137 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:08 smithi089 bash[19831]: audit 2024-09-21T05:25:08.306669+0000 mgr.x (mgr.24511) 138 : audit [DBG] from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:09.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:08 smithi089 bash[26514]: audit 2024-09-21T05:25:08.123565+0000 mgr.x (mgr.24511) 137 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:09.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:08 smithi089 bash[26514]: audit 2024-09-21T05:25:08.306669+0000 mgr.x (mgr.24511) 138 : audit [DBG] from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:08 smithi110 bash[22020]: audit 2024-09-21T05:25:08.123565+0000 mgr.x (mgr.24511) 137 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:08 smithi110 bash[22020]: audit 2024-09-21T05:25:08.306669+0000 mgr.x (mgr.24511) 138 : audit [DBG] from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:09.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ls' 2024-09-21T05:25:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:09 smithi089 bash[19831]: cluster 2024-09-21T05:25:08.633311+0000 mgr.x (mgr.24511) 139 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:10.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:09 smithi089 bash[26514]: cluster 2024-09-21T05:25:08.633311+0000 mgr.x (mgr.24511) 139 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:10.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:09 smithi110 bash[22020]: cluster 2024-09-21T05:25:08.633311+0000 mgr.x (mgr.24511) 139 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:10 smithi089 bash[19831]: audit 2024-09-21T05:25:10.339900+0000 mon.c (mon.2) 225 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:10 smithi089 bash[26514]: audit 2024-09-21T05:25:10.339900+0000 mon.c (mon.2) 225 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:10 smithi110 bash[22020]: audit 2024-09-21T05:25:10.339900+0000 mon.c (mon.2) 225 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:11 smithi089 bash[19831]: cluster 2024-09-21T05:25:10.634831+0000 mgr.x (mgr.24511) 140 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:11 smithi089 bash[26514]: cluster 2024-09-21T05:25:10.634831+0000 mgr.x (mgr.24511) 140 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:11 smithi110 bash[22020]: cluster 2024-09-21T05:25:10.634831+0000 mgr.x (mgr.24511) 140 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:12.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:11 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:25:11] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:25:13.900 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:25:14.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:13 smithi089 bash[19831]: cluster 2024-09-21T05:25:12.635573+0000 mgr.x (mgr.24511) 141 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:14.008 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:13 smithi089 bash[26514]: cluster 2024-09-21T05:25:12.635573+0000 mgr.x (mgr.24511) 141 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:13 smithi110 bash[22020]: cluster 2024-09-21T05:25:12.635573+0000 mgr.x (mgr.24511) 141 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager ?:9093,9094 1/1 2m ago 25m smithi089=a;count:1 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:grafana ?:3000 1/1 2m ago 24m smithi110=a;count:1 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo ?:5000 1/1 2m ago 22m count:1 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:mgr 2/2 2m ago 33m smithi089=y;smithi110=x;count:2 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:mon 3/3 2m ago 33m smithi089:172.21.15.89=a;smithi089:[v2:172.21.15.89:3301,v1:172.21.15.89:6790]=c;smithi110:172.21.15.110=b;count:3 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter ?:9100 2/2 2m ago 25m smithi089=a;smithi110=b;count:2 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd 8 2m ago - 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus ?:9095 1/1 2m ago 25m smithi110=a;count:1 2024-09-21T05:25:15.361 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo ?:8000 2/2 2m ago 22m count:2 2024-09-21T05:25:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:15 smithi089 bash[19831]: cluster 2024-09-21T05:25:14.636277+0000 mgr.x (mgr.24511) 142 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:15 smithi089 bash[19831]: audit 2024-09-21T05:25:15.345686+0000 mgr.x (mgr.24511) 143 : audit [DBG] from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:15 smithi089 bash[26514]: cluster 2024-09-21T05:25:14.636277+0000 mgr.x (mgr.24511) 142 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:15 smithi089 bash[26514]: audit 2024-09-21T05:25:15.345686+0000 mgr.x (mgr.24511) 143 : audit [DBG] from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:15 smithi110 bash[22020]: cluster 2024-09-21T05:25:14.636277+0000 mgr.x (mgr.24511) 142 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:16.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:15 smithi110 bash[22020]: audit 2024-09-21T05:25:15.345686+0000 mgr.x (mgr.24511) 143 : audit [DBG] from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:16.121 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions' 2024-09-21T05:25:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:17 smithi089 bash[26514]: cluster 2024-09-21T05:25:16.638000+0000 mgr.x (mgr.24511) 144 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:17 smithi089 bash[19831]: cluster 2024-09-21T05:25:16.638000+0000 mgr.x (mgr.24511) 144 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:17 smithi110 bash[22020]: cluster 2024-09-21T05:25:16.638000+0000 mgr.x (mgr.24511) 144 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:18 smithi089 bash[19831]: audit 2024-09-21T05:25:18.134680+0000 mgr.x (mgr.24511) 145 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:18 smithi089 bash[26514]: audit 2024-09-21T05:25:18.134680+0000 mgr.x (mgr.24511) 145 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:18 smithi110 bash[22020]: audit 2024-09-21T05:25:18.134680+0000 mgr.x (mgr.24511) 145 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:19 smithi089 bash[19831]: cluster 2024-09-21T05:25:18.638846+0000 mgr.x (mgr.24511) 146 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:19 smithi089 bash[26514]: cluster 2024-09-21T05:25:18.638846+0000 mgr.x (mgr.24511) 146 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:19 smithi110 bash[22020]: cluster 2024-09-21T05:25:18.638846+0000 mgr.x (mgr.24511) 146 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:20.933 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[26514]: cluster 2024-09-21T05:25:20.640558+0000 mgr.x (mgr.24511) 147 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[26514]: audit 2024-09-21T05:25:21.197620+0000 mon.c (mon.2) 226 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[26514]: audit 2024-09-21T05:25:21.199348+0000 mon.c (mon.2) 227 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[26514]: audit 2024-09-21T05:25:21.209543+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[19831]: cluster 2024-09-21T05:25:20.640558+0000 mgr.x (mgr.24511) 147 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[19831]: audit 2024-09-21T05:25:21.197620+0000 mon.c (mon.2) 226 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[19831]: audit 2024-09-21T05:25:21.199348+0000 mon.c (mon.2) 227 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:22.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:21 smithi089 bash[19831]: audit 2024-09-21T05:25:21.209543+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:22.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:21 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:25:21] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:25:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:21 smithi110 bash[22020]: cluster 2024-09-21T05:25:20.640558+0000 mgr.x (mgr.24511) 147 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:21 smithi110 bash[22020]: audit 2024-09-21T05:25:21.197620+0000 mon.c (mon.2) 226 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:21 smithi110 bash[22020]: audit 2024-09-21T05:25:21.199348+0000 mon.c (mon.2) 227 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:22.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:21 smithi110 bash[22020]: audit 2024-09-21T05:25:21.209543+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:22.357 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:25:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:25:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:25:22.358 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:25:22.358 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:25:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:22 smithi089 bash[26514]: audit 2024-09-21T05:25:22.356088+0000 mon.c (mon.2) 228 : audit [DBG] from='client.? 172.21.15.89:0/221607027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:22 smithi089 bash[19831]: audit 2024-09-21T05:25:22.356088+0000 mon.c (mon.2) 228 : audit [DBG] from='client.? 172.21.15.89:0/221607027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:22 smithi110 bash[22020]: audit 2024-09-21T05:25:22.356088+0000 mon.c (mon.2) 228 : audit [DBG] from='client.? 172.21.15.89:0/221607027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:23.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T05:25:24.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:23 smithi089 bash[19831]: cluster 2024-09-21T05:25:22.641287+0000 mgr.x (mgr.24511) 148 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:23 smithi089 bash[26514]: cluster 2024-09-21T05:25:22.641287+0000 mgr.x (mgr.24511) 148 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:23 smithi110 bash[22020]: cluster 2024-09-21T05:25:22.641287+0000 mgr.x (mgr.24511) 148 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:25 smithi089 bash[19831]: cluster 2024-09-21T05:25:24.641974+0000 mgr.x (mgr.24511) 149 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:26.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:25 smithi089 bash[19831]: audit 2024-09-21T05:25:25.340264+0000 mon.c (mon.2) 229 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:25 smithi089 bash[26514]: cluster 2024-09-21T05:25:24.641974+0000 mgr.x (mgr.24511) 149 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:25 smithi089 bash[26514]: audit 2024-09-21T05:25:25.340264+0000 mon.c (mon.2) 229 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:25 smithi110 bash[22020]: cluster 2024-09-21T05:25:24.641974+0000 mgr.x (mgr.24511) 149 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:25 smithi110 bash[22020]: audit 2024-09-21T05:25:25.340264+0000 mon.c (mon.2) 229 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:27.887 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:25:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:27 smithi089 bash[19831]: cluster 2024-09-21T05:25:26.643690+0000 mgr.x (mgr.24511) 150 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:27 smithi089 bash[26514]: cluster 2024-09-21T05:25:26.643690+0000 mgr.x (mgr.24511) 150 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:27 smithi110 bash[22020]: cluster 2024-09-21T05:25:26.643690+0000 mgr.x (mgr.24511) 150 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:28 smithi089 bash[19831]: audit 2024-09-21T05:25:28.139810+0000 mgr.x (mgr.24511) 151 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:28 smithi089 bash[26514]: audit 2024-09-21T05:25:28.139810+0000 mgr.x (mgr.24511) 151 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:28 smithi110 bash[22020]: audit 2024-09-21T05:25:28.139810+0000 mgr.x (mgr.24511) 151 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:29 smithi089 bash[19831]: cluster 2024-09-21T05:25:28.644423+0000 mgr.x (mgr.24511) 152 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:29 smithi089 bash[26514]: cluster 2024-09-21T05:25:28.644423+0000 mgr.x (mgr.24511) 152 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:29 smithi110 bash[22020]: cluster 2024-09-21T05:25:28.644423+0000 mgr.x (mgr.24511) 152 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:31.155 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:30 smithi089 bash[19831]: audit 2024-09-21T05:25:29.484806+0000 mgr.x (mgr.24511) 153 : audit [DBG] from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:31.155 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:30 smithi089 bash[26514]: audit 2024-09-21T05:25:29.484806+0000 mgr.x (mgr.24511) 153 : audit [DBG] from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:30 smithi110 bash[22020]: audit 2024-09-21T05:25:29.484806+0000 mgr.x (mgr.24511) 153 : audit [DBG] from='client.15369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:31.831 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:31 smithi089 bash[19831]: cluster 2024-09-21T05:25:30.645955+0000 mgr.x (mgr.24511) 154 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:31 smithi089 bash[26514]: cluster 2024-09-21T05:25:30.645955+0000 mgr.x (mgr.24511) 154 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:31 smithi110 bash[22020]: cluster 2024-09-21T05:25:30.645955+0000 mgr.x (mgr.24511) 154 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:32.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:31 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:25:31] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.43.0" 2024-09-21T05:25:32.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:25:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: cephadm 2024-09-21T05:25:31.822988+0000 mgr.x (mgr.24511) 155 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: audit 2024-09-21T05:25:31.827929+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: audit 2024-09-21T05:25:31.831897+0000 mon.c (mon.2) 230 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: audit 2024-09-21T05:25:31.833784+0000 mon.c (mon.2) 231 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: audit 2024-09-21T05:25:31.843003+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[19831]: cephadm 2024-09-21T05:25:31.964688+0000 mgr.x (mgr.24511) 156 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: cephadm 2024-09-21T05:25:31.822988+0000 mgr.x (mgr.24511) 155 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: audit 2024-09-21T05:25:31.827929+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: audit 2024-09-21T05:25:31.831897+0000 mon.c (mon.2) 230 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: audit 2024-09-21T05:25:31.833784+0000 mon.c (mon.2) 231 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: audit 2024-09-21T05:25:31.843003+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:32 smithi089 bash[26514]: cephadm 2024-09-21T05:25:31.964688+0000 mgr.x (mgr.24511) 156 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: cephadm 2024-09-21T05:25:31.822988+0000 mgr.x (mgr.24511) 155 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: audit 2024-09-21T05:25:31.827929+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: audit 2024-09-21T05:25:31.831897+0000 mon.c (mon.2) 230 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:33.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: audit 2024-09-21T05:25:31.833784+0000 mon.c (mon.2) 231 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:33.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: audit 2024-09-21T05:25:31.843003+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:33.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:32 smithi110 bash[22020]: cephadm 2024-09-21T05:25:31.964688+0000 mgr.x (mgr.24511) 156 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:25:34.031 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:33 smithi089 bash[19831]: cluster 2024-09-21T05:25:32.646608+0000 mgr.x (mgr.24511) 157 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:34.031 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:33 smithi089 bash[26514]: cluster 2024-09-21T05:25:32.646608+0000 mgr.x (mgr.24511) 157 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:33 smithi110 bash[22020]: cluster 2024-09-21T05:25:32.646608+0000 mgr.x (mgr.24511) 157 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:25:35.047 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:34 smithi089 bash[68019]: [21/Sep/2024:05:25:34] ENGINE Bus STOPPING 2024-09-21T05:25:35.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:34 smithi110 bash[50043]: debug 2024-09-21T05:25:34.554+0000 7f077ae14640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-21T05:25:35.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:34 smithi110 bash[50043]: ignoring --setuser ceph since I am not root 2024-09-21T05:25:35.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:34 smithi110 bash[50043]: ignoring --setgroup ceph since I am not root 2024-09-21T05:25:35.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:34 smithi110 bash[50043]: debug 2024-09-21T05:25:34.614+0000 7fc2732f7640 1 -- 172.21.15.110:0/1374329861 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c02f3f10e0 con 0x55c02f3f2800 2024-09-21T05:25:35.514 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[68019]: [21/Sep/2024:05:25:35] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:25:35.514 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[68019]: [21/Sep/2024:05:25:35] ENGINE Bus STOPPED 2024-09-21T05:25:35.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[68019]: [21/Sep/2024:05:25:35] ENGINE Bus STARTING 2024-09-21T05:25:35.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[68019]: [21/Sep/2024:05:25:35] ENGINE Serving on http://:::9283 2024-09-21T05:25:35.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[68019]: [21/Sep/2024:05:25:35] ENGINE Bus STARTED 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.513672+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.521912+0000 mon.c (mon.2) 232 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.531338+0000 mon.c (mon.2) 233 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.532011+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: cluster 2024-09-21T05:25:34.532824+0000 mon.a (mon.0) 1246 : cluster [INF] Activating manager daemon y 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.538887+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: cluster 2024-09-21T05:25:34.549295+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: cluster 2024-09-21T05:25:34.552849+0000 mon.a (mon.0) 1249 : cluster [DBG] mgrmap e37: y(active, starting, since 0.0200198s) 2024-09-21T05:25:35.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.554707+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.554988+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.555146+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.556482+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.556760+0000 mon.a (mon.0) 1254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.556992+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.557285+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.557694+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.558017+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.558427+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.558819+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.559154+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.559498+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.559655+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:25:35.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:34.560166+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: cluster 2024-09-21T05:25:35.100376+0000 mon.a (mon.0) 1265 : cluster [INF] Manager daemon y is now available 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:35.445705+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:35.445882+0000 mon.a (mon.0) 1267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:35.452001+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[19831]: audit 2024-09-21T05:25:35.494444+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.513672+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.521912+0000 mon.c (mon.2) 232 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.531338+0000 mon.c (mon.2) 233 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.532011+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: cluster 2024-09-21T05:25:34.532824+0000 mon.a (mon.0) 1246 : cluster [INF] Activating manager daemon y 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.538887+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-21T05:25:35.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: cluster 2024-09-21T05:25:34.549295+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: cluster 2024-09-21T05:25:34.552849+0000 mon.a (mon.0) 1249 : cluster [DBG] mgrmap e37: y(active, starting, since 0.0200198s) 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.554707+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.554988+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.555146+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.556482+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.556760+0000 mon.a (mon.0) 1254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.556992+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.557285+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.557694+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.558017+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.558427+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.558819+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.559154+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.559498+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:25:35.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.559655+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:34.560166+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: cluster 2024-09-21T05:25:35.100376+0000 mon.a (mon.0) 1265 : cluster [INF] Manager daemon y is now available 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:35.445705+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:35.445882+0000 mon.a (mon.0) 1267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:35.452001+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:25:35.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:35 smithi089 bash[26514]: audit 2024-09-21T05:25:35.494444+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:25:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.513672+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24511 ' entity='mgr.x' 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.521912+0000 mon.c (mon.2) 232 : audit [DBG] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.531338+0000 mon.c (mon.2) 233 : audit [INF] from='mgr.24511 172.21.15.110:0/1940635970' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.532011+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: cluster 2024-09-21T05:25:34.532824+0000 mon.a (mon.0) 1246 : cluster [INF] Activating manager daemon y 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.538887+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24511 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: cluster 2024-09-21T05:25:34.549295+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: cluster 2024-09-21T05:25:34.552849+0000 mon.a (mon.0) 1249 : cluster [DBG] mgrmap e37: y(active, starting, since 0.0200198s) 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.554707+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.554988+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.555146+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.556482+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-21T05:25:35.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.556760+0000 mon.a (mon.0) 1254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.556992+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.557285+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.557694+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.558017+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.558427+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.558819+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.559154+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.559498+0000 mon.a (mon.0) 1262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.559655+0000 mon.a (mon.0) 1263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:34.560166+0000 mon.a (mon.0) 1264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: cluster 2024-09-21T05:25:35.100376+0000 mon.a (mon.0) 1265 : cluster [INF] Manager daemon y is now available 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:35.445705+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:35.445882+0000 mon.a (mon.0) 1267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:35.452001+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-21T05:25:35.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:35 smithi110 bash[22020]: audit 2024-09-21T05:25:35.494444+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-21T05:25:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:36 smithi110 bash[22020]: cluster 2024-09-21T05:25:35.551914+0000 mon.a (mon.0) 1270 : cluster [DBG] mgrmap e38: y(active, since 1.01909s) 2024-09-21T05:25:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:36 smithi110 bash[22020]: audit 2024-09-21T05:25:35.566390+0000 mgr.y (mgr.25142) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:36 smithi110 bash[22020]: cluster 2024-09-21T05:25:35.571310+0000 mgr.y (mgr.25142) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[19831]: cluster 2024-09-21T05:25:35.551914+0000 mon.a (mon.0) 1270 : cluster [DBG] mgrmap e38: y(active, since 1.01909s) 2024-09-21T05:25:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[19831]: audit 2024-09-21T05:25:35.566390+0000 mgr.y (mgr.25142) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[19831]: cluster 2024-09-21T05:25:35.571310+0000 mgr.y (mgr.25142) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[26514]: cluster 2024-09-21T05:25:35.551914+0000 mon.a (mon.0) 1270 : cluster [DBG] mgrmap e38: y(active, since 1.01909s) 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[26514]: audit 2024-09-21T05:25:35.566390+0000 mgr.y (mgr.25142) 1 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[26514]: cluster 2024-09-21T05:25:35.571310+0000 mgr.y (mgr.25142) 2 : cluster [DBG] pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: debug 2024-09-21T05:25:36.644+0000 7f1a51f9b640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:05:25:36] ENGINE Error in HTTPServer.serve 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: Traceback (most recent call last): 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: self._connections.run(self.expiration_interval) 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: self._run(expiration_interval) 2024-09-21T05:25:37.048 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: s = self.context.wrap_socket( 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: return self.sslsocket_class._create( 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: self.do_handshake() 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: self._sslobj.do_handshake() 2024-09-21T05:25:37.049 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:25:36 smithi089 bash[68019]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:25:38.033 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:25:38.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:37 smithi089 bash[19831]: cephadm 2024-09-21T05:25:36.521709+0000 mgr.y (mgr.25142) 3 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTING 2024-09-21T05:25:38.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:37 smithi089 bash[19831]: cluster 2024-09-21T05:25:36.558515+0000 mgr.y (mgr.25142) 4 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:37 smithi089 bash[26514]: cephadm 2024-09-21T05:25:36.521709+0000 mgr.y (mgr.25142) 3 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTING 2024-09-21T05:25:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:37 smithi089 bash[26514]: cluster 2024-09-21T05:25:36.558515+0000 mgr.y (mgr.25142) 4 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:37 smithi110 bash[22020]: cephadm 2024-09-21T05:25:36.521709+0000 mgr.y (mgr.25142) 3 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTING 2024-09-21T05:25:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:37 smithi110 bash[22020]: cluster 2024-09-21T05:25:36.558515+0000 mgr.y (mgr.25142) 4 : cluster [DBG] pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: cephadm 2024-09-21T05:25:36.642794+0000 mgr.y (mgr.25142) 5 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: cephadm 2024-09-21T05:25:36.646021+0000 mgr.y (mgr.25142) 6 : cephadm [ERR] [21/Sep/2024:05:25:36] ENGINE Error in HTTPServer.serve 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: Traceback (most recent call last): 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: self._connections.run(self.expiration_interval) 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: self._run(expiration_interval) 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:25:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: s = self.context.wrap_socket( 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: return self.sslsocket_class._create( 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: self.do_handshake() 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: self._sslobj.do_handshake() 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: cephadm 2024-09-21T05:25:36.744249+0000 mgr.y (mgr.25142) 7 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: cephadm 2024-09-21T05:25:36.744393+0000 mgr.y (mgr.25142) 8 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTED 2024-09-21T05:25:39.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[19831]: cluster 2024-09-21T05:25:37.565033+0000 mon.a (mon.0) 1271 : cluster [DBG] mgrmap e39: y(active, since 3s) 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: cephadm 2024-09-21T05:25:36.642794+0000 mgr.y (mgr.25142) 5 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: cephadm 2024-09-21T05:25:36.646021+0000 mgr.y (mgr.25142) 6 : cephadm [ERR] [21/Sep/2024:05:25:36] ENGINE Error in HTTPServer.serve 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: Traceback (most recent call last): 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: self._connections.run(self.expiration_interval) 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: self._run(expiration_interval) 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: s = self.context.wrap_socket( 2024-09-21T05:25:39.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: return self.sslsocket_class._create( 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: self.do_handshake() 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: self._sslobj.do_handshake() 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: cephadm 2024-09-21T05:25:36.744249+0000 mgr.y (mgr.25142) 7 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: cephadm 2024-09-21T05:25:36.744393+0000 mgr.y (mgr.25142) 8 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTED 2024-09-21T05:25:39.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:38 smithi089 bash[26514]: cluster 2024-09-21T05:25:37.565033+0000 mon.a (mon.0) 1271 : cluster [DBG] mgrmap e39: y(active, since 3s) 2024-09-21T05:25:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: cephadm 2024-09-21T05:25:36.642794+0000 mgr.y (mgr.25142) 5 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on https://172.21.15.89:7150 2024-09-21T05:25:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: cephadm 2024-09-21T05:25:36.646021+0000 mgr.y (mgr.25142) 6 : cephadm [ERR] [21/Sep/2024:05:25:36] ENGINE Error in HTTPServer.serve 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: Traceback (most recent call last): 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: self._connections.run(self.expiration_interval) 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: self._run(expiration_interval) 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: s = self.context.wrap_socket( 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: return self.sslsocket_class._create( 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T05:25:39.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: self.do_handshake() 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: self._sslobj.do_handshake() 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: cephadm 2024-09-21T05:25:36.744249+0000 mgr.y (mgr.25142) 7 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Serving on http://172.21.15.89:8765 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: cephadm 2024-09-21T05:25:36.744393+0000 mgr.y (mgr.25142) 8 : cephadm [INF] [21/Sep/2024:05:25:36] ENGINE Bus STARTED 2024-09-21T05:25:39.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:38 smithi110 bash[22020]: cluster 2024-09-21T05:25:37.565033+0000 mon.a (mon.0) 1271 : cluster [DBG] mgrmap e39: y(active, since 3s) 2024-09-21T05:25:39.777 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:25:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:39 smithi089 bash[19831]: audit 2024-09-21T05:25:38.148563+0000 mgr.y (mgr.25142) 9 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:39 smithi089 bash[19831]: cluster 2024-09-21T05:25:38.559413+0000 mgr.y (mgr.25142) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:39 smithi089 bash[26514]: audit 2024-09-21T05:25:38.148563+0000 mgr.y (mgr.25142) 9 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:39 smithi089 bash[26514]: cluster 2024-09-21T05:25:38.559413+0000 mgr.y (mgr.25142) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:39 smithi110 bash[22020]: audit 2024-09-21T05:25:38.148563+0000 mgr.y (mgr.25142) 9 : audit [DBG] from='client.15303 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:40.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:39 smithi110 bash[22020]: cluster 2024-09-21T05:25:38.559413+0000 mgr.y (mgr.25142) 10 : cluster [DBG] pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:40.428 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:25:40.428 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (24m) 3m ago 25m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:25:40.428 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (24m) 3m ago 24m 76.0M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (3m) 3m ago 22m 46.8M - 3.8 164465d2334a a56b06f0989a 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (17m) 3m ago 33m 495M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 74403a18a285 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (10m) 3m ago 35m 438M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (35m) 3m ago 35m 79.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (33m) 3m ago 34m 58.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (33m) 3m ago 33m 60.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (25m) 3m ago 25m 9111k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (25m) 3m ago 25m 8775k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (32m) 3m ago 32m 56.7M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (31m) 3m ago 31m 65.8M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (30m) 3m ago 31m 61.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (30m) 3m ago 30m 56.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (29m) 3m ago 29m 70.6M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (28m) 3m ago 28m 54.5M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (27m) 3m ago 27m 62.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:25:40.429 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (26m) 3m ago 26m 63.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:25:40.430 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (3m) 3m ago 25m 31.1M - 2.43.0 a07b618ecd1d 4c31f909b570 2024-09-21T05:25:40.430 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (22m) 3m ago 22m 101M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:25:40.430 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (22m) 3m ago 22m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:25:40.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:25:40.802 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:25:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:40 smithi089 bash[19831]: cluster 2024-09-21T05:25:39.577739+0000 mon.a (mon.0) 1272 : cluster [DBG] mgrmap e40: y(active, since 5s) 2024-09-21T05:25:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:40 smithi089 bash[26514]: cluster 2024-09-21T05:25:39.577739+0000 mon.a (mon.0) 1272 : cluster [DBG] mgrmap e40: y(active, since 5s) 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[22020]: cluster 2024-09-21T05:25:39.577739+0000 mon.a (mon.0) 1272 : cluster [DBG] mgrmap e40: y(active, since 5s) 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[50043]: [21/Sep/2024:05:25:40] ENGINE Bus STARTING 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[50043]: CherryPy Checker: 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[50043]: The Application mounted at '' has an empty config. 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[50043]: [21/Sep/2024:05:25:40] ENGINE Serving on http://:::9283 2024-09-21T05:25:41.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:40 smithi110 bash[50043]: [21/Sep/2024:05:25:40] ENGINE Bus STARTED 2024-09-21T05:25:41.124 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:25:41.124 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:25:41.124 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:25:41.124 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:25:41.125 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:25:42.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:39.763366+0000 mgr.y (mgr.25142) 11 : audit [DBG] from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.082995+0000 mgr.y (mgr.25142) 12 : audit [DBG] from='client.15411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.389887+0000 mgr.y (mgr.25142) 13 : audit [DBG] from='client.25292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: cluster 2024-09-21T05:25:40.560089+0000 mgr.y (mgr.25142) 14 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: cluster 2024-09-21T05:25:40.682957+0000 mon.a (mon.0) 1273 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.684630+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.685398+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.687156+0000 mon.b (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.688454+0000 mon.b (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[26514]: audit 2024-09-21T05:25:40.800283+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.89:0/1626386257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:39.763366+0000 mgr.y (mgr.25142) 11 : audit [DBG] from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.082995+0000 mgr.y (mgr.25142) 12 : audit [DBG] from='client.15411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.389887+0000 mgr.y (mgr.25142) 13 : audit [DBG] from='client.25292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: cluster 2024-09-21T05:25:40.560089+0000 mgr.y (mgr.25142) 14 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: cluster 2024-09-21T05:25:40.682957+0000 mon.a (mon.0) 1273 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.684630+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.685398+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.687156+0000 mon.b (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.688454+0000 mon.b (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:25:42.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:41 smithi089 bash[19831]: audit 2024-09-21T05:25:40.800283+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.89:0/1626386257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[50043]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:25:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:39.763366+0000 mgr.y (mgr.25142) 11 : audit [DBG] from='client.15405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.082995+0000 mgr.y (mgr.25142) 12 : audit [DBG] from='client.15411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.389887+0000 mgr.y (mgr.25142) 13 : audit [DBG] from='client.25292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: cluster 2024-09-21T05:25:40.560089+0000 mgr.y (mgr.25142) 14 : cluster [DBG] pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: cluster 2024-09-21T05:25:40.682957+0000 mon.a (mon.0) 1273 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:25:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.684630+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:25:42.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.685398+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:25:42.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.687156+0000 mon.b (mon.1) 36 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:25:42.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.688454+0000 mon.b (mon.1) 37 : audit [DBG] from='mgr.? 172.21.15.110:0/1888237708' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:25:42.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:41 smithi110 bash[22020]: audit 2024-09-21T05:25:40.800283+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.89:0/1626386257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:25:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.124015+0000 mgr.y (mgr.25142) 15 : audit [DBG] from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: cluster 2024-09-21T05:25:41.590613+0000 mon.a (mon.0) 1275 : cluster [DBG] mgrmap e41: y(active, since 7s), standbys: x 2024-09-21T05:25:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.590749+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.808771+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.817652+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.824487+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[19831]: audit 2024-09-21T05:25:41.829454+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.124015+0000 mgr.y (mgr.25142) 15 : audit [DBG] from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: cluster 2024-09-21T05:25:41.590613+0000 mon.a (mon.0) 1275 : cluster [DBG] mgrmap e41: y(active, since 7s), standbys: x 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.590749+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.808771+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.817652+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.824487+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:42 smithi089 bash[26514]: audit 2024-09-21T05:25:41.829454+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.124015+0000 mgr.y (mgr.25142) 15 : audit [DBG] from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: cluster 2024-09-21T05:25:41.590613+0000 mon.a (mon.0) 1275 : cluster [DBG] mgrmap e41: y(active, since 7s), standbys: x 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.590749+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.808771+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.817652+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.824487+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:42 smithi110 bash[22020]: audit 2024-09-21T05:25:41.829454+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: cluster 2024-09-21T05:25:42.561720+0000 mgr.y (mgr.25142) 16 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.950639+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.955734+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.960489+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.965405+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.967189+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:42.967913+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.289802+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.294723+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.301054+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.306098+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.311944+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.868 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.333353+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[19831]: audit 2024-09-21T05:25:43.340086+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: cluster 2024-09-21T05:25:42.561720+0000 mgr.y (mgr.25142) 16 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.950639+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.955734+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.960489+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.965405+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.967189+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:42.967913+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:43.869 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.289802+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.294723+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.301054+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.306098+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.311944+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.333353+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:25:43.870 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:43 smithi089 bash[26514]: audit 2024-09-21T05:25:43.340086+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: cluster 2024-09-21T05:25:42.561720+0000 mgr.y (mgr.25142) 16 : cluster [DBG] pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.950639+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.955734+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.960489+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.965405+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.967189+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:42.967913+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.289802+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.294723+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.301054+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.306098+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.311944+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.333353+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi089.vkfkma", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-21T05:25:44.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:43 smithi110 bash[22020]: audit 2024-09-21T05:25:43.340086+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:42.968873+0000 mgr.y (mgr.25142) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:42.969074+0000 mgr.y (mgr.25142) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.046990+0000 mgr.y (mgr.25142) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.050949+0000 mgr.y (mgr.25142) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.124441+0000 mgr.y (mgr.25142) 21 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.127723+0000 mgr.y (mgr.25142) 22 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.205744+0000 mgr.y (mgr.25142) 23 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.209536+0000 mgr.y (mgr.25142) 24 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.332962+0000 mgr.y (mgr.25142) 25 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:25:44.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[26514]: cephadm 2024-09-21T05:25:43.340919+0000 mgr.y (mgr.25142) 26 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:42.968873+0000 mgr.y (mgr.25142) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:42.969074+0000 mgr.y (mgr.25142) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.046990+0000 mgr.y (mgr.25142) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.050949+0000 mgr.y (mgr.25142) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.124441+0000 mgr.y (mgr.25142) 21 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.127723+0000 mgr.y (mgr.25142) 22 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.205744+0000 mgr.y (mgr.25142) 23 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.209536+0000 mgr.y (mgr.25142) 24 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.332962+0000 mgr.y (mgr.25142) 25 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:25:44.931 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:44 smithi089 bash[19831]: cephadm 2024-09-21T05:25:43.340919+0000 mgr.y (mgr.25142) 26 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:25:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:42.968873+0000 mgr.y (mgr.25142) 17 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.conf 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:42.969074+0000 mgr.y (mgr.25142) 18 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.conf 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.046990+0000 mgr.y (mgr.25142) 19 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.050949+0000 mgr.y (mgr.25142) 20 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.124441+0000 mgr.y (mgr.25142) 21 : cephadm [INF] Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.127723+0000 mgr.y (mgr.25142) 22 : cephadm [INF] Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.205744+0000 mgr.y (mgr.25142) 23 : cephadm [INF] Updating smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.209536+0000 mgr.y (mgr.25142) 24 : cephadm [INF] Updating smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.332962+0000 mgr.y (mgr.25142) 25 : cephadm [INF] Reconfiguring iscsi.foo.smithi089.vkfkma (dependencies changed)... 2024-09-21T05:25:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:44 smithi110 bash[22020]: cephadm 2024-09-21T05:25:43.340919+0000 mgr.y (mgr.25142) 26 : cephadm [INF] Reconfiguring daemon iscsi.foo.smithi089.vkfkma on smithi089 2024-09-21T05:25:45.862 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:45 smithi089 bash[19831]: cluster 2024-09-21T05:25:44.562164+0000 mgr.y (mgr.25142) 27 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:25:45.863 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:45 smithi089 bash[26514]: cluster 2024-09-21T05:25:44.562164+0000 mgr.y (mgr.25142) 27 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:25:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:45 smithi110 bash[22020]: cluster 2024-09-21T05:25:44.562164+0000 mgr.y (mgr.25142) 27 : cluster [DBG] pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T05:25:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:47 smithi110 bash[22020]: cluster 2024-09-21T05:25:46.563026+0000 mgr.y (mgr.25142) 28 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:47 smithi110 bash[22020]: audit 2024-09-21T05:25:46.634959+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:47 smithi110 bash[22020]: audit 2024-09-21T05:25:46.640303+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:47.953 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[19831]: cluster 2024-09-21T05:25:46.563026+0000 mgr.y (mgr.25142) 28 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:47.953 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[19831]: audit 2024-09-21T05:25:46.634959+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:47.953 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[19831]: audit 2024-09-21T05:25:46.640303+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:47.954 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[26514]: cluster 2024-09-21T05:25:46.563026+0000 mgr.y (mgr.25142) 28 : cluster [DBG] pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:47.954 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[26514]: audit 2024-09-21T05:25:46.634959+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:47.954 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:47 smithi089 bash[26514]: audit 2024-09-21T05:25:46.640303+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:48.906 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:48 smithi110 bash[22020]: cephadm 2024-09-21T05:25:46.641962+0000 mgr.y (mgr.25142) 29 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:25:48.906 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:48 smithi110 bash[22020]: cephadm 2024-09-21T05:25:46.881354+0000 mgr.y (mgr.25142) 30 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:25:48.906 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:48 smithi110 bash[22020]: audit 2024-09-21T05:25:48.239760+0000 mon.c (mon.2) 234 : audit [DBG] from='client.? 172.21.15.89:0/2444913243' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:25:49.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[19831]: cephadm 2024-09-21T05:25:46.641962+0000 mgr.y (mgr.25142) 29 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:25:49.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[19831]: cephadm 2024-09-21T05:25:46.881354+0000 mgr.y (mgr.25142) 30 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:25:49.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[19831]: audit 2024-09-21T05:25:48.239760+0000 mon.c (mon.2) 234 : audit [DBG] from='client.? 172.21.15.89:0/2444913243' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:25:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[26514]: cephadm 2024-09-21T05:25:46.641962+0000 mgr.y (mgr.25142) 29 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-21T05:25:49.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[26514]: cephadm 2024-09-21T05:25:46.881354+0000 mgr.y (mgr.25142) 30 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi110 2024-09-21T05:25:49.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:48 smithi089 bash[26514]: audit 2024-09-21T05:25:48.239760+0000 mon.c (mon.2) 234 : audit [DBG] from='client.? 172.21.15.89:0/2444913243' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-21T05:25:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:49 smithi110 bash[22020]: cluster 2024-09-21T05:25:48.563720+0000 mgr.y (mgr.25142) 31 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:49 smithi089 bash[19831]: cluster 2024-09-21T05:25:48.563720+0000 mgr.y (mgr.25142) 31 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:49 smithi089 bash[26514]: cluster 2024-09-21T05:25:48.563720+0000 mgr.y (mgr.25142) 31 : cluster [DBG] pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:50 smithi110 bash[22020]: audit 2024-09-21T05:25:50.446432+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:50 smithi089 bash[19831]: audit 2024-09-21T05:25:50.446432+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:50 smithi089 bash[26514]: audit 2024-09-21T05:25:50.446432+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.333Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.334Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:25:51.548 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.334Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:25:51.549 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.334Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:25:51.549 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[54935]: ts=2024-09-21T05:25:51.334Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:25:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[22020]: cluster 2024-09-21T05:25:50.564771+0000 mgr.y (mgr.25142) 32 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:51 smithi089 bash[19831]: cluster 2024-09-21T05:25:50.564771+0000 mgr.y (mgr.25142) 32 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:51 smithi089 bash[26514]: cluster 2024-09-21T05:25:50.564771+0000 mgr.y (mgr.25142) 32 : cluster [DBG] pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T05:25:52.115 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:51 smithi110 bash[56134]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:25:52.115 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:52 smithi110 bash[56197]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:25:52.115 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:52 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:25:52.116 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:52 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:25:52.116 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:52 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.064190+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.075037+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.081200+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.082645+0000 mgr.y (mgr.25142) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.102871+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: cephadm 2024-09-21T05:25:52.105198+0000 mgr.y (mgr.25142) 34 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.105767+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.106736+0000 mgr.y (mgr.25142) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.109087+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.109829+0000 mgr.y (mgr.25142) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.119340+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.125931+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.126583+0000 mgr.y (mgr.25142) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: audit 2024-09-21T05:25:52.178018+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[19831]: cluster 2024-09-21T05:25:52.566383+0000 mgr.y (mgr.25142) 38 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.064190+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.075037+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.081200+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.082645+0000 mgr.y (mgr.25142) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.102871+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: cephadm 2024-09-21T05:25:52.105198+0000 mgr.y (mgr.25142) 34 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.105767+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.106736+0000 mgr.y (mgr.25142) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.109087+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.109829+0000 mgr.y (mgr.25142) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.119340+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.125931+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.126583+0000 mgr.y (mgr.25142) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: audit 2024-09-21T05:25:52.178018+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:53 smithi089 bash[26514]: cluster 2024-09-21T05:25:52.566383+0000 mgr.y (mgr.25142) 38 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:53.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.064190+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.075037+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.081200+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.082645+0000 mgr.y (mgr.25142) 33 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.102871+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: cephadm 2024-09-21T05:25:52.105198+0000 mgr.y (mgr.25142) 34 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.89:5000 to Dashboard 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.105767+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.106736+0000 mgr.y (mgr.25142) 35 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.109087+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.109829+0000 mgr.y (mgr.25142) 36 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi089"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.119340+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.125931+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.126583+0000 mgr.y (mgr.25142) 37 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: audit 2024-09-21T05:25:52.178018+0000 mon.a (mon.0) 1305 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:25:53.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[22020]: cluster 2024-09-21T05:25:52.566383+0000 mgr.y (mgr.25142) 38 : cluster [DBG] pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T05:25:53.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.826Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-21T05:25:53.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.826Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-21T05:25:53.975 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.826Z caller=main.go:570 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.826Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.826Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.828Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.828Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.830Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.830Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.832Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.833Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=798.159µs 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.833Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.833Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=5 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.847Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=5 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.851Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=5 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.854Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=5 2024-09-21T05:25:53.976 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.858Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=5 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.859Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=5 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.859Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=30.798µs wal_replay_duration=25.80862ms wbl_replay_duration=136ns total_replay_duration=26.661462ms 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.861Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.861Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.861Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.883Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.123958ms db_storage=955ns remote_storage=1.25µs web_handler=413ns query_engine=642ns scrape=255.228µs scrape_sd=119.893µs notify=13.743µs notify_sd=10.056µs rules=20.291502ms tracing=5.92µs 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.883Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-21T05:25:53.977 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:53 smithi110 bash[56224]: ts=2024-09-21T05:25:53.883Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:25:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:54 smithi089 bash[26514]: cluster 2024-09-21T05:25:54.567152+0000 mgr.y (mgr.25142) 39 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:25:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:54 smithi089 bash[19831]: cluster 2024-09-21T05:25:54.567152+0000 mgr.y (mgr.25142) 39 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:25:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:54 smithi110 bash[22020]: cluster 2024-09-21T05:25:54.567152+0000 mgr.y (mgr.25142) 39 : cluster [DBG] pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:25:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[19831]: cephadm 2024-09-21T05:25:54.798309+0000 mgr.y (mgr.25142) 40 : cephadm [INF] Upgrade: Updating mgr.x 2024-09-21T05:25:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[19831]: audit 2024-09-21T05:25:54.799051+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:25:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[19831]: audit 2024-09-21T05:25:54.800988+0000 mon.a (mon.0) 1307 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:25:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[19831]: audit 2024-09-21T05:25:54.803044+0000 mon.a (mon.0) 1308 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:56.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[19831]: cephadm 2024-09-21T05:25:54.805032+0000 mgr.y (mgr.25142) 41 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:25:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[26514]: cephadm 2024-09-21T05:25:54.798309+0000 mgr.y (mgr.25142) 40 : cephadm [INF] Upgrade: Updating mgr.x 2024-09-21T05:25:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[26514]: audit 2024-09-21T05:25:54.799051+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:25:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[26514]: audit 2024-09-21T05:25:54.800988+0000 mon.a (mon.0) 1307 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:25:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[26514]: audit 2024-09-21T05:25:54.803044+0000 mon.a (mon.0) 1308 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:56.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:55 smithi089 bash[26514]: cephadm 2024-09-21T05:25:54.805032+0000 mgr.y (mgr.25142) 41 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:25:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:55 smithi110 bash[22020]: cephadm 2024-09-21T05:25:54.798309+0000 mgr.y (mgr.25142) 40 : cephadm [INF] Upgrade: Updating mgr.x 2024-09-21T05:25:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:55 smithi110 bash[22020]: audit 2024-09-21T05:25:54.799051+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T05:25:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:55 smithi110 bash[22020]: audit 2024-09-21T05:25:54.800988+0000 mon.a (mon.0) 1307 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T05:25:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:55 smithi110 bash[22020]: audit 2024-09-21T05:25:54.803044+0000 mon.a (mon.0) 1308 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:25:56.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:55 smithi110 bash[22020]: cephadm 2024-09-21T05:25:54.805032+0000 mgr.y (mgr.25142) 41 : cephadm [INF] Deploying daemon mgr.x on smithi110 2024-09-21T05:25:57.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:56 smithi089 bash[19831]: cluster 2024-09-21T05:25:56.568832+0000 mgr.y (mgr.25142) 42 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:56 smithi089 bash[26514]: cluster 2024-09-21T05:25:56.568832+0000 mgr.y (mgr.25142) 42 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:56 smithi110 bash[22020]: cluster 2024-09-21T05:25:56.568832+0000 mgr.y (mgr.25142) 42 : cluster [DBG] pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:25:57.427 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.428 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.428 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.428 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.429 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.429 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.429 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.429 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.430 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:57.779 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:57 smithi110 systemd[1]: Stopping Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 bash[56496]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-x 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 bash[56557]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mgr-x 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service: Failed with result 'exit-code'. 2024-09-21T05:25:58.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: Stopped Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:25:58.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.804 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.805 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.806 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.806 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.806 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:25:58.806 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:25:58 smithi110 systemd[1]: Started Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:25:59.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[19831]: audit 2024-09-21T05:25:57.970295+0000 mgr.y (mgr.25142) 43 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[19831]: audit 2024-09-21T05:25:58.544354+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[19831]: audit 2024-09-21T05:25:58.554477+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[19831]: cluster 2024-09-21T05:25:58.569682+0000 mgr.y (mgr.25142) 44 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[26514]: audit 2024-09-21T05:25:57.970295+0000 mgr.y (mgr.25142) 43 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[26514]: audit 2024-09-21T05:25:58.544354+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[26514]: audit 2024-09-21T05:25:58.554477+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:25:59 smithi089 bash[26514]: cluster 2024-09-21T05:25:58.569682+0000 mgr.y (mgr.25142) 44 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:25:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:59 smithi110 bash[22020]: audit 2024-09-21T05:25:57.970295+0000 mgr.y (mgr.25142) 43 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:25:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:59 smithi110 bash[22020]: audit 2024-09-21T05:25:58.544354+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:59 smithi110 bash[22020]: audit 2024-09-21T05:25:58.554477+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:25:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:25:59 smithi110 bash[22020]: cluster 2024-09-21T05:25:58.569682+0000 mgr.y (mgr.25142) 44 : cluster [DBG] pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:26:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:00 smithi089 bash[19831]: cluster 2024-09-21T05:26:00.570712+0000 mgr.y (mgr.25142) 45 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:26:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:00 smithi089 bash[26514]: cluster 2024-09-21T05:26:00.570712+0000 mgr.y (mgr.25142) 45 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:26:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:00 smithi110 bash[22020]: cluster 2024-09-21T05:26:00.570712+0000 mgr.y (mgr.25142) 45 : cluster [DBG] pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:26:02.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:01 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:01] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.43.0" 2024-09-21T05:26:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:02 smithi089 bash[19831]: cluster 2024-09-21T05:26:02.572262+0000 mgr.y (mgr.25142) 46 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:02 smithi089 bash[26514]: cluster 2024-09-21T05:26:02.572262+0000 mgr.y (mgr.25142) 46 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:02 smithi110 bash[22020]: cluster 2024-09-21T05:26:02.572262+0000 mgr.y (mgr.25142) 46 : cluster [DBG] pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: audit 2024-09-21T05:26:04.482077+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: audit 2024-09-21T05:26:04.488976+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: cluster 2024-09-21T05:26:04.572951+0000 mgr.y (mgr.25142) 47 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: audit 2024-09-21T05:26:04.603515+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: audit 2024-09-21T05:26:04.616055+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[19831]: audit 2024-09-21T05:26:05.446938+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: audit 2024-09-21T05:26:04.482077+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: audit 2024-09-21T05:26:04.488976+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: cluster 2024-09-21T05:26:04.572951+0000 mgr.y (mgr.25142) 47 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: audit 2024-09-21T05:26:04.603515+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: audit 2024-09-21T05:26:04.616055+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:05 smithi089 bash[26514]: audit 2024-09-21T05:26:05.446938+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:05.800 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[56614]: [21/Sep/2024:05:26:05] ENGINE Bus STARTING 2024-09-21T05:26:05.800 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[56614]: CherryPy Checker: 2024-09-21T05:26:05.800 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[56614]: The Application mounted at '' has an empty config. 2024-09-21T05:26:05.800 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[56614]: [21/Sep/2024:05:26:05] ENGINE Serving on http://:::9283 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: audit 2024-09-21T05:26:04.482077+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: audit 2024-09-21T05:26:04.488976+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: cluster 2024-09-21T05:26:04.572951+0000 mgr.y (mgr.25142) 47 : cluster [DBG] pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: audit 2024-09-21T05:26:04.603515+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: audit 2024-09-21T05:26:04.616055+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:05.801 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[22020]: audit 2024-09-21T05:26:05.446938+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:06.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:05 smithi110 bash[56614]: [21/Sep/2024:05:26:05] ENGINE Bus STARTED 2024-09-21T05:26:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: cluster 2024-09-21T05:26:05.690399+0000 mon.a (mon.0) 1316 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: cluster 2024-09-21T05:26:05.690576+0000 mon.a (mon.0) 1317 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.694145+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.694935+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.698101+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.698617+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.794368+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[19831]: audit 2024-09-21T05:26:05.807488+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: cluster 2024-09-21T05:26:05.690399+0000 mon.a (mon.0) 1316 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: cluster 2024-09-21T05:26:05.690576+0000 mon.a (mon.0) 1317 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:26:06.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.694145+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:26:06.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.694935+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:26:06.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.698101+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:26:06.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.698617+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:26:06.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.794368+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:06.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:06 smithi089 bash[26514]: audit 2024-09-21T05:26:05.807488+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: cluster 2024-09-21T05:26:05.690399+0000 mon.a (mon.0) 1316 : cluster [DBG] Standby manager daemon x restarted 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: cluster 2024-09-21T05:26:05.690576+0000 mon.a (mon.0) 1317 : cluster [DBG] Standby manager daemon x started 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.694145+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.694935+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.698101+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-21T05:26:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.698617+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.? 172.21.15.110:0/3803593436' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T05:26:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.794368+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:06 smithi110 bash[22020]: audit 2024-09-21T05:26:05.807488+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:07 smithi089 bash[19831]: cluster 2024-09-21T05:26:06.525342+0000 mon.a (mon.0) 1320 : cluster [DBG] mgrmap e42: y(active, since 31s), standbys: x 2024-09-21T05:26:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:07 smithi089 bash[19831]: cluster 2024-09-21T05:26:06.574681+0000 mgr.y (mgr.25142) 48 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:07.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:07 smithi089 bash[26514]: cluster 2024-09-21T05:26:06.525342+0000 mon.a (mon.0) 1320 : cluster [DBG] mgrmap e42: y(active, since 31s), standbys: x 2024-09-21T05:26:07.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:07 smithi089 bash[26514]: cluster 2024-09-21T05:26:06.574681+0000 mgr.y (mgr.25142) 48 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:07 smithi110 bash[22020]: cluster 2024-09-21T05:26:06.525342+0000 mon.a (mon.0) 1320 : cluster [DBG] mgrmap e42: y(active, since 31s), standbys: x 2024-09-21T05:26:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:07 smithi110 bash[22020]: cluster 2024-09-21T05:26:06.574681+0000 mgr.y (mgr.25142) 48 : cluster [DBG] pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:08 smithi089 bash[26514]: audit 2024-09-21T05:26:07.974452+0000 mgr.y (mgr.25142) 49 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:08 smithi089 bash[26514]: cluster 2024-09-21T05:26:08.575449+0000 mgr.y (mgr.25142) 50 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:09.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:08 smithi089 bash[19831]: audit 2024-09-21T05:26:07.974452+0000 mgr.y (mgr.25142) 49 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:09.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:08 smithi089 bash[19831]: cluster 2024-09-21T05:26:08.575449+0000 mgr.y (mgr.25142) 50 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:08 smithi110 bash[22020]: audit 2024-09-21T05:26:07.974452+0000 mgr.y (mgr.25142) 49 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:08 smithi110 bash[22020]: cluster 2024-09-21T05:26:08.575449+0000 mgr.y (mgr.25142) 50 : cluster [DBG] pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:10.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:10 smithi089 bash[19831]: cluster 2024-09-21T05:26:10.577438+0000 mgr.y (mgr.25142) 51 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:10.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:10 smithi089 bash[26514]: cluster 2024-09-21T05:26:10.577438+0000 mgr.y (mgr.25142) 51 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:10.969 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:10 smithi110 bash[22020]: cluster 2024-09-21T05:26:10.577438+0000 mgr.y (mgr.25142) 51 : cluster [DBG] pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:26:11.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:11 smithi089 bash[19831]: audit 2024-09-21T05:26:11.454873+0000 mgr.y (mgr.25142) 52 : audit [DBG] from='client.15465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:11.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:11 smithi089 bash[26514]: audit 2024-09-21T05:26:11.454873+0000 mgr.y (mgr.25142) 52 : audit [DBG] from='client.15465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:11.947 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:11 smithi110 bash[22020]: audit 2024-09-21T05:26:11.454873+0000 mgr.y (mgr.25142) 52 : audit [DBG] from='client.15465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:12.116 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:26:12.116 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (25m) 7s ago 25m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (25m) 7s ago 25m 75.9M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (25s) 7s ago 23m 47.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (13s) 7s ago 34m 158M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (11m) 7s ago 36m 495M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (36m) 7s ago 36m 86.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (34m) 7s ago 34m 61.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (34m) 7s ago 34m 64.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (25m) 7s ago 25m 9127k - 1.5.0 0da6a335fe13 670336494c36 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (25m) 7s ago 25m 8964k - 1.5.0 0da6a335fe13 8e1cd3facf65 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (33m) 7s ago 33m 58.1M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (32m) 7s ago 32m 67.8M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (31m) 7s ago 31m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (30m) 7s ago 30m 58.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (29m) 7s ago 29m 73.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:26:12.117 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (28m) 7s ago 28m 56.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:26:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (27m) 7s ago 27m 64.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:26:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (26m) 7s ago 27m 65.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:26:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (20s) 7s ago 26m 34.9M - 2.43.0 a07b618ecd1d d64846308bef 2024-09-21T05:26:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (23m) 7s ago 23m 101M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:26:12.118 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (23m) 7s ago 23m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:26:12.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:11 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:11] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:26:12.494 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:26:12.495 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:26:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[19831]: audit 2024-09-21T05:26:11.768610+0000 mgr.y (mgr.25142) 53 : audit [DBG] from='client.25346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[19831]: audit 2024-09-21T05:26:12.078301+0000 mgr.y (mgr.25142) 54 : audit [DBG] from='client.25352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[19831]: audit 2024-09-21T05:26:12.493614+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.89:0/1807668771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[19831]: cluster 2024-09-21T05:26:12.578002+0000 mgr.y (mgr.25142) 55 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[26514]: audit 2024-09-21T05:26:11.768610+0000 mgr.y (mgr.25142) 53 : audit [DBG] from='client.25346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:12.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[26514]: audit 2024-09-21T05:26:12.078301+0000 mgr.y (mgr.25142) 54 : audit [DBG] from='client.25352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:12.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[26514]: audit 2024-09-21T05:26:12.493614+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.89:0/1807668771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:12.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:12 smithi089 bash[26514]: cluster 2024-09-21T05:26:12.578002+0000 mgr.y (mgr.25142) 55 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:12.812 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:26:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:26:12.813 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:26:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:12 smithi110 bash[22020]: audit 2024-09-21T05:26:11.768610+0000 mgr.y (mgr.25142) 53 : audit [DBG] from='client.25346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:12 smithi110 bash[22020]: audit 2024-09-21T05:26:12.078301+0000 mgr.y (mgr.25142) 54 : audit [DBG] from='client.25352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:12 smithi110 bash[22020]: audit 2024-09-21T05:26:12.493614+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.89:0/1807668771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:12 smithi110 bash[22020]: cluster 2024-09-21T05:26:12.578002+0000 mgr.y (mgr.25142) 55 : cluster [DBG] pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:13 smithi089 bash[19831]: audit 2024-09-21T05:26:12.812214+0000 mgr.y (mgr.25142) 56 : audit [DBG] from='client.15489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:13 smithi089 bash[26514]: audit 2024-09-21T05:26:12.812214+0000 mgr.y (mgr.25142) 56 : audit [DBG] from='client.15489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:13 smithi110 bash[22020]: audit 2024-09-21T05:26:12.812214+0000 mgr.y (mgr.25142) 56 : audit [DBG] from='client.15489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:15.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[26514]: audit 2024-09-21T05:26:14.426209+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[26514]: audit 2024-09-21T05:26:14.438867+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[26514]: cluster 2024-09-21T05:26:14.578668+0000 mgr.y (mgr.25142) 57 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:15.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[19831]: audit 2024-09-21T05:26:14.426209+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[19831]: audit 2024-09-21T05:26:14.438867+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:15 smithi089 bash[19831]: cluster 2024-09-21T05:26:14.578668+0000 mgr.y (mgr.25142) 57 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:15 smithi110 bash[22020]: audit 2024-09-21T05:26:14.426209+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:15 smithi110 bash[22020]: audit 2024-09-21T05:26:14.438867+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:15 smithi110 bash[22020]: cluster 2024-09-21T05:26:14.578668+0000 mgr.y (mgr.25142) 57 : cluster [DBG] pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:16.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.585204+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.595933+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.598158+0000 mon.a (mon.0) 1326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:16.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.600142+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.611136+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.714587+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.717690+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.728353+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.733617+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.739386+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.743478+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.748196+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.752496+0000 mon.a (mon.0) 1336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.758681+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.763393+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.769896+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.774397+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.780912+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.784549+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.791772+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.795956+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.804547+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.809910+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.818035+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.824732+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[19831]: audit 2024-09-21T05:26:15.832974+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.585204+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.595933+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.598158+0000 mon.a (mon.0) 1326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.600142+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.611136+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.714587+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.717690+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.728353+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.733617+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-21T05:26:16.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.739386+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.743478+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.748196+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.752496+0000 mon.a (mon.0) 1336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.758681+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.763393+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.769896+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.774397+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.780912+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.784549+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.791772+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.795956+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.804547+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.809910+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.818035+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:16.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.824732+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:16.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:16 smithi089 bash[26514]: audit 2024-09-21T05:26:15.832974+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.585204+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.595933+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.598158+0000 mon.a (mon.0) 1326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.600142+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.611136+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.714587+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.717690+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.728353+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.733617+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.739386+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.743478+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.748196+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.752496+0000 mon.a (mon.0) 1336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.758681+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.763393+0000 mon.a (mon.0) 1338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.769896+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.774397+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.780912+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.784549+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.791772+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.795956+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.804547+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.809910+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.818035+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.824732+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:17.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:16 smithi110 bash[22020]: audit 2024-09-21T05:26:15.832974+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:17.933 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.718962+0000 mgr.y (mgr.25142) 58 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:26:17.933 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.753696+0000 mgr.y (mgr.25142) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:26:17.933 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.764738+0000 mgr.y (mgr.25142) 60 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:26:17.933 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.775840+0000 mgr.y (mgr.25142) 61 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.786212+0000 mgr.y (mgr.25142) 62 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.797543+0000 mgr.y (mgr.25142) 63 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.811416+0000 mgr.y (mgr.25142) 64 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cephadm 2024-09-21T05:26:15.826532+0000 mgr.y (mgr.25142) 65 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[26514]: cluster 2024-09-21T05:26:16.580482+0000 mgr.y (mgr.25142) 66 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.718962+0000 mgr.y (mgr.25142) 58 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.753696+0000 mgr.y (mgr.25142) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.764738+0000 mgr.y (mgr.25142) 60 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.775840+0000 mgr.y (mgr.25142) 61 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.786212+0000 mgr.y (mgr.25142) 62 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.797543+0000 mgr.y (mgr.25142) 63 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:26:17.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.811416+0000 mgr.y (mgr.25142) 64 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:26:17.935 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cephadm 2024-09-21T05:26:15.826532+0000 mgr.y (mgr.25142) 65 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:26:17.935 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:17 smithi089 bash[19831]: cluster 2024-09-21T05:26:16.580482+0000 mgr.y (mgr.25142) 66 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.718962+0000 mgr.y (mgr.25142) 58 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.753696+0000 mgr.y (mgr.25142) 59 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.764738+0000 mgr.y (mgr.25142) 60 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.775840+0000 mgr.y (mgr.25142) 61 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.786212+0000 mgr.y (mgr.25142) 62 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.797543+0000 mgr.y (mgr.25142) 63 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.811416+0000 mgr.y (mgr.25142) 64 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cephadm 2024-09-21T05:26:15.826532+0000 mgr.y (mgr.25142) 65 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:26:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:17 smithi110 bash[22020]: cluster 2024-09-21T05:26:16.580482+0000 mgr.y (mgr.25142) 66 : cluster [DBG] pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:19.274 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.274 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.275 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.275 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.275 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.276 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.276 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.276 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:19.276 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: Stopping Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:26:19.276 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:19 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[26514]: audit 2024-09-21T05:26:17.985675+0000 mgr.y (mgr.25142) 67 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[26514]: cephadm 2024-09-21T05:26:18.421562+0000 mgr.y (mgr.25142) 68 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-09-21T05:26:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[26514]: cephadm 2024-09-21T05:26:18.422145+0000 mgr.y (mgr.25142) 69 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:26:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[26514]: cluster 2024-09-21T05:26:18.581199+0000 mgr.y (mgr.25142) 70 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[19831]: audit 2024-09-21T05:26:17.985675+0000 mgr.y (mgr.25142) 67 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[19831]: cephadm 2024-09-21T05:26:18.421562+0000 mgr.y (mgr.25142) 68 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-09-21T05:26:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[19831]: cephadm 2024-09-21T05:26:18.422145+0000 mgr.y (mgr.25142) 69 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:26:20.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:19 smithi089 bash[19831]: cluster 2024-09-21T05:26:18.581199+0000 mgr.y (mgr.25142) 70 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:19 smithi110 bash[22020]: audit 2024-09-21T05:26:17.985675+0000 mgr.y (mgr.25142) 67 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:19 smithi110 bash[22020]: cephadm 2024-09-21T05:26:18.421562+0000 mgr.y (mgr.25142) 68 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-09-21T05:26:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:19 smithi110 bash[22020]: cephadm 2024-09-21T05:26:18.422145+0000 mgr.y (mgr.25142) 69 : cephadm [INF] Deploying daemon node-exporter.a on smithi089 2024-09-21T05:26:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:19 smithi110 bash[22020]: cluster 2024-09-21T05:26:18.581199+0000 mgr.y (mgr.25142) 70 : cluster [DBG] pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:20.450 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 bash[78644]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-a 2024-09-21T05:26:20.748 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.748 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.748 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.749 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:20 smithi089 bash[19831]: audit 2024-09-21T05:26:20.447348+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:20.749 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.749 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 bash[78705]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-a 2024-09-21T05:26:20.749 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:26:20.749 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-21T05:26:20.749 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: Stopped Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:26:20.750 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.750 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.750 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:20.750 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:20 smithi089 bash[26514]: audit 2024-09-21T05:26:20.447348+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:20.750 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:21.047 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 systemd[1]: Started Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:26:21.047 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:20 smithi089 bash[78759]: Unable to find image 'quay.io/prometheus/node-exporter:v1.7.0' locally 2024-09-21T05:26:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:20 smithi110 bash[22020]: audit 2024-09-21T05:26:20.447348+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:21.606 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: v1.7.0: Pulling from prometheus/node-exporter 2024-09-21T05:26:21.606 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 2abcce694348: Pulling fs layer 2024-09-21T05:26:21.606 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 455fd88e5221: Pulling fs layer 2024-09-21T05:26:21.606 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 324153f2810a: Pulling fs layer 2024-09-21T05:26:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:21 smithi110 bash[22020]: cluster 2024-09-21T05:26:20.582010+0000 mgr.y (mgr.25142) 71 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:21 smithi110 bash[22020]: audit 2024-09-21T05:26:20.789528+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:21 smithi110 bash[22020]: audit 2024-09-21T05:26:20.795197+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.989 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:21] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:26:21.989 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[19831]: cluster 2024-09-21T05:26:20.582010+0000 mgr.y (mgr.25142) 71 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:21.989 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[19831]: audit 2024-09-21T05:26:20.789528+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.989 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[19831]: audit 2024-09-21T05:26:20.795197+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.989 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[26514]: cluster 2024-09-21T05:26:20.582010+0000 mgr.y (mgr.25142) 71 : cluster [DBG] pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:21.990 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[26514]: audit 2024-09-21T05:26:20.789528+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.990 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[26514]: audit 2024-09-21T05:26:20.795197+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:21.990 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 2abcce694348: Download complete 2024-09-21T05:26:21.990 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 455fd88e5221: Download complete 2024-09-21T05:26:21.990 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:21 smithi089 bash[78759]: 2abcce694348: Pull complete 2024-09-21T05:26:22.797 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:22 smithi089 bash[78759]: 324153f2810a: Download complete 2024-09-21T05:26:22.797 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:22 smithi089 bash[78759]: 455fd88e5221: Pull complete 2024-09-21T05:26:23.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:22 smithi089 bash[78759]: 324153f2810a: Pull complete 2024-09-21T05:26:23.297 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:23 smithi089 bash[78759]: Digest: sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80 2024-09-21T05:26:23.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:23 smithi089 bash[78759]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T05:26:23.945 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:23 smithi110 bash[22020]: cluster 2024-09-21T05:26:22.582760+0000 mgr.y (mgr.25142) 72 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:24.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:23 smithi089 bash[19831]: cluster 2024-09-21T05:26:22.582760+0000 mgr.y (mgr.25142) 72 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:23 smithi089 bash[26514]: cluster 2024-09-21T05:26:22.582760+0000 mgr.y (mgr.25142) 72 : cluster [DBG] pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:24.210 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.210 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.210 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.211 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.211 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.211 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.212 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.212 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 systemd[1]: Stopping Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:26:24.212 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.212 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:24.883 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 bash[59864]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-b 2024-09-21T05:26:24.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:24 smithi110 bash[22020]: cephadm 2024-09-21T05:26:23.268443+0000 mgr.y (mgr.25142) 73 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-09-21T05:26:24.884 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:24 smithi110 bash[22020]: cephadm 2024-09-21T05:26:23.269694+0000 mgr.y (mgr.25142) 74 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:26:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[19831]: cephadm 2024-09-21T05:26:23.268443+0000 mgr.y (mgr.25142) 73 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-09-21T05:26:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[19831]: cephadm 2024-09-21T05:26:23.269694+0000 mgr.y (mgr.25142) 74 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:26:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[26514]: cephadm 2024-09-21T05:26:23.268443+0000 mgr.y (mgr.25142) 73 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-09-21T05:26:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[26514]: cephadm 2024-09-21T05:26:23.269694+0000 mgr.y (mgr.25142) 74 : cephadm [INF] Deploying daemon node-exporter.b on smithi110 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.815Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.815Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.816Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.816Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.816Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.816Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T05:26:25.048 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T05:26:25.049 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T05:26:25.050 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.817Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T05:26:25.051 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:26:24 smithi089 bash[78759]: ts=2024-09-21T05:26:24.818Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T05:26:25.167 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.168 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.168 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.168 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.168 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.169 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.169 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.169 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.169 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:26:25.169 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 bash[59925]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-b 2024-09-21T05:26:25.169 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-21T05:26:25.170 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:24 smithi110 systemd[1]: Stopped Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:26:25.170 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:25.170 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 systemd[1]: Started Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:26:25.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[59980]: Unable to find image 'quay.io/prometheus/node-exporter:v1.7.0' locally 2024-09-21T05:26:25.938 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[59980]: v1.7.0: Pulling from prometheus/node-exporter 2024-09-21T05:26:25.939 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[22020]: cluster 2024-09-21T05:26:24.583452+0000 mgr.y (mgr.25142) 75 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:25.939 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[22020]: audit 2024-09-21T05:26:25.176452+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:25.939 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[22020]: audit 2024-09-21T05:26:25.188938+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[19831]: cluster 2024-09-21T05:26:24.583452+0000 mgr.y (mgr.25142) 75 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[19831]: audit 2024-09-21T05:26:25.176452+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[19831]: audit 2024-09-21T05:26:25.188938+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[26514]: cluster 2024-09-21T05:26:24.583452+0000 mgr.y (mgr.25142) 75 : cluster [DBG] pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[26514]: audit 2024-09-21T05:26:25.176452+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:26.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:25 smithi089 bash[26514]: audit 2024-09-21T05:26:25.188938+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:26.280 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[59980]: 2abcce694348: Pulling fs layer 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[59980]: 455fd88e5221: Pulling fs layer 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:25 smithi110 bash[59980]: 324153f2810a: Pulling fs layer 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 455fd88e5221: Verifying Checksum 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 455fd88e5221: Download complete 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 2abcce694348: Verifying Checksum 2024-09-21T05:26:26.281 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 2abcce694348: Download complete 2024-09-21T05:26:26.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 324153f2810a: Verifying Checksum 2024-09-21T05:26:26.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 324153f2810a: Download complete 2024-09-21T05:26:26.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 2abcce694348: Pull complete 2024-09-21T05:26:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:26 smithi089 bash[19831]: cluster 2024-09-21T05:26:26.585201+0000 mgr.y (mgr.25142) 76 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:26 smithi089 bash[26514]: cluster 2024-09-21T05:26:26.585201+0000 mgr.y (mgr.25142) 76 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[22020]: cluster 2024-09-21T05:26:26.585201+0000 mgr.y (mgr.25142) 76 : cluster [DBG] pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:27.054 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:26 smithi110 bash[59980]: 455fd88e5221: Pull complete 2024-09-21T05:26:27.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:27 smithi110 bash[59980]: 324153f2810a: Pull complete 2024-09-21T05:26:27.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:27 smithi110 bash[59980]: Digest: sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80 2024-09-21T05:26:27.554 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:27 smithi110 bash[59980]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.7.0 2024-09-21T05:26:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:28 smithi089 bash[19831]: audit 2024-09-21T05:26:27.996742+0000 mgr.y (mgr.25142) 77 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:28 smithi089 bash[19831]: cluster 2024-09-21T05:26:28.586105+0000 mgr.y (mgr.25142) 78 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:28 smithi089 bash[26514]: audit 2024-09-21T05:26:27.996742+0000 mgr.y (mgr.25142) 77 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:28 smithi089 bash[26514]: cluster 2024-09-21T05:26:28.586105+0000 mgr.y (mgr.25142) 78 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[22020]: audit 2024-09-21T05:26:27.996742+0000 mgr.y (mgr.25142) 77 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[22020]: cluster 2024-09-21T05:26:28.586105+0000 mgr.y (mgr.25142) 78 : cluster [DBG] pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.869Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.869Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.870Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.870Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=arp 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-21T05:26:29.055 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=edac 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-21T05:26:29.056 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=os 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-21T05:26:29.057 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=stat 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=time 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=uname 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-21T05:26:29.058 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.871Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-21T05:26:29.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.872Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-21T05:26:29.059 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:28 smithi110 bash[59980]: ts=2024-09-21T05:26:28.872Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-21T05:26:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:30 smithi089 bash[19831]: cluster 2024-09-21T05:26:30.586939+0000 mgr.y (mgr.25142) 79 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:30 smithi089 bash[26514]: cluster 2024-09-21T05:26:30.586939+0000 mgr.y (mgr.25142) 79 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:30 smithi110 bash[22020]: cluster 2024-09-21T05:26:30.586939+0000 mgr.y (mgr.25142) 79 : cluster [DBG] pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:32.167 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:31 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:31] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.43.0" 2024-09-21T05:26:32.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:32 smithi089 bash[19831]: audit 2024-09-21T05:26:31.166740+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:32.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:32 smithi089 bash[19831]: audit 2024-09-21T05:26:31.172937+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:32.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:32 smithi089 bash[26514]: audit 2024-09-21T05:26:31.166740+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:32.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:32 smithi089 bash[26514]: audit 2024-09-21T05:26:31.172937+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:32.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:32 smithi110 bash[22020]: audit 2024-09-21T05:26:31.166740+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:32.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:32 smithi110 bash[22020]: audit 2024-09-21T05:26:31.172937+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[19831]: audit 2024-09-21T05:26:32.264964+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[19831]: audit 2024-09-21T05:26:32.270928+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[19831]: audit 2024-09-21T05:26:32.277275+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[19831]: audit 2024-09-21T05:26:32.283915+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[19831]: cluster 2024-09-21T05:26:32.587689+0000 mgr.y (mgr.25142) 80 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[26514]: audit 2024-09-21T05:26:32.264964+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[26514]: audit 2024-09-21T05:26:32.270928+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[26514]: audit 2024-09-21T05:26:32.277275+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[26514]: audit 2024-09-21T05:26:32.283915+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:33 smithi089 bash[26514]: cluster 2024-09-21T05:26:32.587689+0000 mgr.y (mgr.25142) 80 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:33 smithi110 bash[22020]: audit 2024-09-21T05:26:32.264964+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:33 smithi110 bash[22020]: audit 2024-09-21T05:26:32.270928+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:33 smithi110 bash[22020]: audit 2024-09-21T05:26:32.277275+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:33 smithi110 bash[22020]: audit 2024-09-21T05:26:32.283915+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:33.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:33 smithi110 bash[22020]: cluster 2024-09-21T05:26:32.587689+0000 mgr.y (mgr.25142) 80 : cluster [DBG] pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:34.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:34 smithi089 bash[19831]: audit 2024-09-21T05:26:33.367907+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:34.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:34 smithi089 bash[19831]: audit 2024-09-21T05:26:33.380766+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:34 smithi089 bash[26514]: audit 2024-09-21T05:26:33.367907+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:34.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:34 smithi089 bash[26514]: audit 2024-09-21T05:26:33.380766+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:34.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:34 smithi110 bash[22020]: audit 2024-09-21T05:26:33.367907+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:34.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:34 smithi110 bash[22020]: audit 2024-09-21T05:26:33.380766+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:35.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:35 smithi089 bash[19831]: cluster 2024-09-21T05:26:34.588446+0000 mgr.y (mgr.25142) 81 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:35.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:35 smithi089 bash[26514]: cluster 2024-09-21T05:26:34.588446+0000 mgr.y (mgr.25142) 81 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:35 smithi110 bash[22020]: cluster 2024-09-21T05:26:34.588446+0000 mgr.y (mgr.25142) 81 : cluster [DBG] pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:36 smithi089 bash[19831]: audit 2024-09-21T05:26:35.447621+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:36 smithi089 bash[26514]: audit 2024-09-21T05:26:35.447621+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:36 smithi110 bash[22020]: audit 2024-09-21T05:26:35.447621+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:37.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:37 smithi089 bash[19831]: cluster 2024-09-21T05:26:36.590260+0000 mgr.y (mgr.25142) 82 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:37.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:37 smithi089 bash[26514]: cluster 2024-09-21T05:26:36.590260+0000 mgr.y (mgr.25142) 82 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:37.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:37 smithi110 bash[22020]: cluster 2024-09-21T05:26:36.590260+0000 mgr.y (mgr.25142) 82 : cluster [DBG] pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:38 smithi110 bash[22020]: audit 2024-09-21T05:26:38.005722+0000 mgr.y (mgr.25142) 83 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:38 smithi110 bash[22020]: cluster 2024-09-21T05:26:38.590990+0000 mgr.y (mgr.25142) 84 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:38.929 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:38 smithi089 bash[19831]: audit 2024-09-21T05:26:38.005722+0000 mgr.y (mgr.25142) 83 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:38.930 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:38 smithi089 bash[19831]: cluster 2024-09-21T05:26:38.590990+0000 mgr.y (mgr.25142) 84 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:38.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:38 smithi089 bash[26514]: audit 2024-09-21T05:26:38.005722+0000 mgr.y (mgr.25142) 83 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:38.930 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:38 smithi089 bash[26514]: cluster 2024-09-21T05:26:38.590990+0000 mgr.y (mgr.25142) 84 : cluster [DBG] pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:40 smithi089 bash[19831]: cluster 2024-09-21T05:26:40.592515+0000 mgr.y (mgr.25142) 85 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:40 smithi089 bash[26514]: cluster 2024-09-21T05:26:40.592515+0000 mgr.y (mgr.25142) 85 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:40 smithi110 bash[22020]: cluster 2024-09-21T05:26:40.592515+0000 mgr.y (mgr.25142) 85 : cluster [DBG] pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:42.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:41 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:41] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.43.0" 2024-09-21T05:26:43.166 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:26:43.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:42.235771+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:42.245120+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: cluster 2024-09-21T05:26:42.593196+0000 mgr.y (mgr.25142) 86 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.085555+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.095717+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.097502+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.098956+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.108719+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.199417+0000 mon.a (mon.0) 1371 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.201727+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.203433+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.205195+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.206767+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.207888+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.208999+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.210510+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.212333+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[26514]: audit 2024-09-21T05:26:43.213907+0000 mon.a (mon.0) 1380 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:42.235771+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:42.245120+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: cluster 2024-09-21T05:26:42.593196+0000 mgr.y (mgr.25142) 86 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.085555+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.095717+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.097502+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.098956+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:43.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.108719+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.199417+0000 mon.a (mon.0) 1371 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.201727+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.203433+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.205195+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.206767+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.207888+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.208999+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.210510+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.212333+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:43 smithi089 bash[19831]: audit 2024-09-21T05:26:43.213907+0000 mon.a (mon.0) 1380 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:42.235771+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:42.245120+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: cluster 2024-09-21T05:26:42.593196+0000 mgr.y (mgr.25142) 86 : cluster [DBG] pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.085555+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.095717+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.097502+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.098956+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.108719+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.199417+0000 mon.a (mon.0) 1371 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.201727+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.203433+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.205195+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.206767+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.207888+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.208999+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.210510+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.212333+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:43 smithi110 bash[22020]: audit 2024-09-21T05:26:43.213907+0000 mon.a (mon.0) 1380 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (25m) 12s ago 26m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (25m) 11s ago 25m 76.0M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (57s) 12s ago 23m 47.2M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (45s) 11s ago 34m 439M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (11m) 12s ago 36m 499M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:26:43.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (36m) 12s ago 36m 85.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (35m) 11s ago 35m 58.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (34m) 12s ago 34m 61.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (20s) 12s ago 26m 2920k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (16s) 11s ago 26m - - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (33m) 12s ago 33m 58.2M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (32m) 12s ago 33m 67.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (32m) 12s ago 32m 63.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (31m) 12s ago 31m 58.6M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (30m) 11s ago 30m 73.8M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (29m) 11s ago 29m 56.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (28m) 11s ago 28m 64.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (27m) 11s ago 27m 65.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (51s) 11s ago 26m 36.5M - 2.43.0 a07b618ecd1d d64846308bef 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (23m) 12s ago 23m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:26:43.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (24m) 11s ago 24m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:26:44.190 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:26:44.190 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:26:44.190 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:26:44.191 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:26:44.498 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:26:44.499 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:26:44.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[19831]: audit 2024-09-21T05:26:43.153483+0000 mgr.y (mgr.25142) 87 : audit [DBG] from='client.15495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[19831]: audit 2024-09-21T05:26:43.470833+0000 mgr.y (mgr.25142) 88 : audit [DBG] from='client.25376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[19831]: audit 2024-09-21T05:26:44.189972+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.15.89:0/2723686712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:44.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[26514]: audit 2024-09-21T05:26:43.153483+0000 mgr.y (mgr.25142) 87 : audit [DBG] from='client.15495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[26514]: audit 2024-09-21T05:26:43.470833+0000 mgr.y (mgr.25142) 88 : audit [DBG] from='client.25376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:44 smithi089 bash[26514]: audit 2024-09-21T05:26:44.189972+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.15.89:0/2723686712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:44.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:44 smithi110 bash[22020]: audit 2024-09-21T05:26:43.153483+0000 mgr.y (mgr.25142) 87 : audit [DBG] from='client.15495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:44 smithi110 bash[22020]: audit 2024-09-21T05:26:43.470833+0000 mgr.y (mgr.25142) 88 : audit [DBG] from='client.25376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:44.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:44 smithi110 bash[22020]: audit 2024-09-21T05:26:44.189972+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.15.89:0/2723686712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:26:45.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[19831]: audit 2024-09-21T05:26:43.784659+0000 mgr.y (mgr.25142) 89 : audit [DBG] from='client.25382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[19831]: audit 2024-09-21T05:26:44.498019+0000 mgr.y (mgr.25142) 90 : audit [DBG] from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[19831]: cluster 2024-09-21T05:26:44.593917+0000 mgr.y (mgr.25142) 91 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:45.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[26514]: audit 2024-09-21T05:26:43.784659+0000 mgr.y (mgr.25142) 89 : audit [DBG] from='client.25382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[26514]: audit 2024-09-21T05:26:44.498019+0000 mgr.y (mgr.25142) 90 : audit [DBG] from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:45 smithi089 bash[26514]: cluster 2024-09-21T05:26:44.593917+0000 mgr.y (mgr.25142) 91 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:45.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:45 smithi110 bash[22020]: audit 2024-09-21T05:26:43.784659+0000 mgr.y (mgr.25142) 89 : audit [DBG] from='client.25382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:45 smithi110 bash[22020]: audit 2024-09-21T05:26:44.498019+0000 mgr.y (mgr.25142) 90 : audit [DBG] from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:26:45.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:45 smithi110 bash[22020]: cluster 2024-09-21T05:26:44.593917+0000 mgr.y (mgr.25142) 91 : cluster [DBG] pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:46.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:46 smithi089 bash[26514]: cephadm 2024-09-21T05:26:45.471914+0000 mgr.y (mgr.25142) 92 : cephadm [INF] Upgrade: Updating prometheus.a 2024-09-21T05:26:46.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:46 smithi089 bash[19831]: cephadm 2024-09-21T05:26:45.471914+0000 mgr.y (mgr.25142) 92 : cephadm [INF] Upgrade: Updating prometheus.a 2024-09-21T05:26:46.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:46 smithi110 bash[22020]: cephadm 2024-09-21T05:26:45.471914+0000 mgr.y (mgr.25142) 92 : cephadm [INF] Upgrade: Updating prometheus.a 2024-09-21T05:26:47.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:47 smithi089 bash[19831]: cephadm 2024-09-21T05:26:45.729211+0000 mgr.y (mgr.25142) 93 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T05:26:47.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:47 smithi089 bash[19831]: cluster 2024-09-21T05:26:46.595623+0000 mgr.y (mgr.25142) 94 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:47.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:47 smithi089 bash[26514]: cephadm 2024-09-21T05:26:45.729211+0000 mgr.y (mgr.25142) 93 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T05:26:47.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:47 smithi089 bash[26514]: cluster 2024-09-21T05:26:46.595623+0000 mgr.y (mgr.25142) 94 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:47.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:47 smithi110 bash[22020]: cephadm 2024-09-21T05:26:45.729211+0000 mgr.y (mgr.25142) 93 : cephadm [INF] Deploying daemon prometheus.a on smithi110 2024-09-21T05:26:47.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:47 smithi110 bash[22020]: cluster 2024-09-21T05:26:46.595623+0000 mgr.y (mgr.25142) 94 : cluster [DBG] pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:48 smithi089 bash[26514]: audit 2024-09-21T05:26:48.016475+0000 mgr.y (mgr.25142) 95 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:48 smithi089 bash[26514]: cluster 2024-09-21T05:26:48.596458+0000 mgr.y (mgr.25142) 96 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:49.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:48 smithi089 bash[19831]: audit 2024-09-21T05:26:48.016475+0000 mgr.y (mgr.25142) 95 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:49.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:48 smithi089 bash[19831]: cluster 2024-09-21T05:26:48.596458+0000 mgr.y (mgr.25142) 96 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:48 smithi110 bash[22020]: audit 2024-09-21T05:26:48.016475+0000 mgr.y (mgr.25142) 95 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:48 smithi110 bash[22020]: cluster 2024-09-21T05:26:48.596458+0000 mgr.y (mgr.25142) 96 : cluster [DBG] pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:50 smithi089 bash[19831]: audit 2024-09-21T05:26:50.448355+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:50 smithi089 bash[26514]: audit 2024-09-21T05:26:50.448355+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:50 smithi110 bash[22020]: audit 2024-09-21T05:26:50.448355+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:26:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:51 smithi089 bash[26514]: cluster 2024-09-21T05:26:50.598085+0000 mgr.y (mgr.25142) 97 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:51 smithi089 bash[19831]: cluster 2024-09-21T05:26:50.598085+0000 mgr.y (mgr.25142) 97 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:51 smithi110 bash[22020]: cluster 2024-09-21T05:26:50.598085+0000 mgr.y (mgr.25142) 97 : cluster [DBG] pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:52.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:26:51 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:26:51] "GET /metrics HTTP/1.1" 200 38222 "" "Prometheus/2.43.0" 2024-09-21T05:26:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:52 smithi089 bash[19831]: cluster 2024-09-21T05:26:52.598812+0000 mgr.y (mgr.25142) 98 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:52 smithi089 bash[26514]: cluster 2024-09-21T05:26:52.598812+0000 mgr.y (mgr.25142) 98 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:52 smithi110 bash[22020]: cluster 2024-09-21T05:26:52.598812+0000 mgr.y (mgr.25142) 98 : cluster [DBG] pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:54.993 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:54 smithi110 bash[22020]: cluster 2024-09-21T05:26:54.599557+0000 mgr.y (mgr.25142) 99 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:54 smithi089 bash[19831]: cluster 2024-09-21T05:26:54.599557+0000 mgr.y (mgr.25142) 99 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:54 smithi089 bash[26514]: cluster 2024-09-21T05:26:54.599557+0000 mgr.y (mgr.25142) 99 : cluster [DBG] pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:57.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:56 smithi089 bash[19831]: cluster 2024-09-21T05:26:56.601178+0000 mgr.y (mgr.25142) 100 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:56 smithi089 bash[26514]: cluster 2024-09-21T05:26:56.601178+0000 mgr.y (mgr.25142) 100 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:56 smithi110 bash[22020]: cluster 2024-09-21T05:26:56.601178+0000 mgr.y (mgr.25142) 100 : cluster [DBG] pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:26:58.507 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.507 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.508 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.508 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.508 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.509 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.509 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.509 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.509 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:26:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[22020]: audit 2024-09-21T05:26:58.026168+0000 mgr.y (mgr.25142) 101 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[22020]: cluster 2024-09-21T05:26:58.601891+0000 mgr.y (mgr.25142) 102 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.637Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.638Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.638Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.638Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-21T05:26:58.805 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:58 smithi110 bash[56224]: ts=2024-09-21T05:26:58.638Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-21T05:26:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:58 smithi089 bash[19831]: audit 2024-09-21T05:26:58.026168+0000 mgr.y (mgr.25142) 101 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:26:58 smithi089 bash[19831]: cluster 2024-09-21T05:26:58.601891+0000 mgr.y (mgr.25142) 102 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:58 smithi089 bash[26514]: audit 2024-09-21T05:26:58.026168+0000 mgr.y (mgr.25142) 101 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:26:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:26:58 smithi089 bash[26514]: cluster 2024-09-21T05:26:58.601891+0000 mgr.y (mgr.25142) 102 : cluster [DBG] pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:26:59.554 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 bash[63274]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:26:59.554 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 bash[63334]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-prometheus-a 2024-09-21T05:26:59.554 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service: Deactivated successfully. 2024-09-21T05:26:59.554 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: Stopped Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:27:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.054 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.055 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.055 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.056 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: Started Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:27:00.056 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:00.056 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:26:59 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[19831]: audit 2024-09-21T05:26:59.734812+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[19831]: audit 2024-09-21T05:26:59.745284+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[19831]: cluster 2024-09-21T05:27:00.603407+0000 mgr.y (mgr.25142) 103 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:01.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[26514]: audit 2024-09-21T05:26:59.734812+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[26514]: audit 2024-09-21T05:26:59.745284+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:00 smithi089 bash[26514]: cluster 2024-09-21T05:27:00.603407+0000 mgr.y (mgr.25142) 103 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[22020]: audit 2024-09-21T05:26:59.734812+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[22020]: audit 2024-09-21T05:26:59.745284+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[22020]: cluster 2024-09-21T05:27:00.603407+0000 mgr.y (mgr.25142) 103 : cluster [DBG] pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.822Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.822Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.822Z caller=main.go:623 level=info host_details="(Linux 5.15.0-122-generic #132-Ubuntu SMP Thu Aug 29 13:45:52 UTC 2024 x86_64 smithi110 (none))" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.822Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.822Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.824Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.824Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.826Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.826Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.828Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.829Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=939.061µs 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.829Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.830Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=6 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.842Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=6 2024-09-21T05:27:01.055 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.846Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=6 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.850Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=6 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.854Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=6 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.856Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=6 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.856Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=6 maxSegment=6 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.856Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=39.247µs wal_replay_duration=26.897408ms wbl_replay_duration=174ns total_replay_duration=27.899179ms 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.859Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.859Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.859Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.878Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.495495ms db_storage=1.03µs remote_storage=1.429µs web_handler=408ns query_engine=642ns scrape=273.418µs scrape_sd=114.319µs notify=11.108µs notify_sd=20.952µs rules=18.598166ms tracing=8.066µs 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.878Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-21T05:27:01.056 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:27:00 smithi110 bash[63390]: ts=2024-09-21T05:27:00.878Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-21T05:27:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:02 smithi089 bash[26514]: cluster 2024-09-21T05:27:02.604125+0000 mgr.y (mgr.25142) 104 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:03.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:02 smithi089 bash[19831]: cluster 2024-09-21T05:27:02.604125+0000 mgr.y (mgr.25142) 104 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:02 smithi110 bash[22020]: cluster 2024-09-21T05:27:02.604125+0000 mgr.y (mgr.25142) 104 : cluster [DBG] pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:04 smithi089 bash[26514]: cluster 2024-09-21T05:27:04.604833+0000 mgr.y (mgr.25142) 105 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:04 smithi089 bash[19831]: cluster 2024-09-21T05:27:04.604833+0000 mgr.y (mgr.25142) 105 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:04 smithi110 bash[22020]: cluster 2024-09-21T05:27:04.604833+0000 mgr.y (mgr.25142) 105 : cluster [DBG] pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:05 smithi089 bash[26514]: audit 2024-09-21T05:27:05.448762+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:05 smithi089 bash[19831]: audit 2024-09-21T05:27:05.448762+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:05 smithi110 bash[22020]: audit 2024-09-21T05:27:05.448762+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:06.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:06] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:27:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[26514]: audit 2024-09-21T05:27:05.772925+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[26514]: audit 2024-09-21T05:27:05.785736+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[26514]: cluster 2024-09-21T05:27:06.606539+0000 mgr.y (mgr.25142) 106 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:07.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[19831]: audit 2024-09-21T05:27:05.772925+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[19831]: audit 2024-09-21T05:27:05.785736+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:06 smithi089 bash[19831]: cluster 2024-09-21T05:27:06.606539+0000 mgr.y (mgr.25142) 106 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:06 smithi110 bash[22020]: audit 2024-09-21T05:27:05.772925+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:06 smithi110 bash[22020]: audit 2024-09-21T05:27:05.785736+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:06 smithi110 bash[22020]: cluster 2024-09-21T05:27:06.606539+0000 mgr.y (mgr.25142) 106 : cluster [DBG] pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:08.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:07 smithi089 bash[26514]: audit 2024-09-21T05:27:06.935164+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:08.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:07 smithi089 bash[26514]: audit 2024-09-21T05:27:06.945801+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:08.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:07 smithi089 bash[19831]: audit 2024-09-21T05:27:06.935164+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:08.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:07 smithi089 bash[19831]: audit 2024-09-21T05:27:06.945801+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:07 smithi110 bash[22020]: audit 2024-09-21T05:27:06.935164+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:07 smithi110 bash[22020]: audit 2024-09-21T05:27:06.945801+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:08 smithi089 bash[26514]: audit 2024-09-21T05:27:08.036360+0000 mgr.y (mgr.25142) 107 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:08 smithi089 bash[26514]: cluster 2024-09-21T05:27:08.607245+0000 mgr.y (mgr.25142) 108 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:09.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:08 smithi089 bash[19831]: audit 2024-09-21T05:27:08.036360+0000 mgr.y (mgr.25142) 107 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:09.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:08 smithi089 bash[19831]: cluster 2024-09-21T05:27:08.607245+0000 mgr.y (mgr.25142) 108 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:08 smithi110 bash[22020]: audit 2024-09-21T05:27:08.036360+0000 mgr.y (mgr.25142) 107 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:08 smithi110 bash[22020]: cluster 2024-09-21T05:27:08.607245+0000 mgr.y (mgr.25142) 108 : cluster [DBG] pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:10 smithi089 bash[19831]: cluster 2024-09-21T05:27:10.608788+0000 mgr.y (mgr.25142) 109 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:10 smithi089 bash[26514]: cluster 2024-09-21T05:27:10.608788+0000 mgr.y (mgr.25142) 109 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:10 smithi110 bash[22020]: cluster 2024-09-21T05:27:10.608788+0000 mgr.y (mgr.25142) 109 : cluster [DBG] pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:12.999 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:12 smithi110 bash[22020]: cluster 2024-09-21T05:27:12.609481+0000 mgr.y (mgr.25142) 110 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:12 smithi089 bash[19831]: cluster 2024-09-21T05:27:12.609481+0000 mgr.y (mgr.25142) 110 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:12 smithi089 bash[26514]: cluster 2024-09-21T05:27:12.609481+0000 mgr.y (mgr.25142) 110 : cluster [DBG] pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:14.842 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:27:15.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:14 smithi089 bash[26514]: cluster 2024-09-21T05:27:14.609965+0000 mgr.y (mgr.25142) 111 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:14 smithi089 bash[19831]: cluster 2024-09-21T05:27:14.609965+0000 mgr.y (mgr.25142) 111 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:14 smithi110 bash[22020]: cluster 2024-09-21T05:27:14.609965+0000 mgr.y (mgr.25142) 111 : cluster [DBG] pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (26m) 44s ago 26m 14.2M - 0.25.0 c8568f914cd2 a7a509970cfe 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (26m) 9s ago 26m 76.0M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (88s) 44s ago 24m 47.2M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (76s) 9s ago 35m 440M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (12m) 44s ago 37m 499M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (37m) 44s ago 37m 85.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (35m) 9s ago 35m 58.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (35m) 44s ago 35m 61.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (52s) 44s ago 26m 2920k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (47s) 9s ago 26m 7724k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:27:15.460 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (34m) 44s ago 34m 58.2M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (33m) 44s ago 33m 67.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (32m) 44s ago 32m 63.4M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (31m) 44s ago 31m 58.6M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (30m) 9s ago 30m 73.9M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (29m) 9s ago 29m 56.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (28m) 9s ago 29m 64.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (28m) 9s ago 28m 65.2M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (15s) 9s ago 27m 33.6M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (24m) 44s ago 24m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:27:15.461 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (24m) 9s ago 24m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:15.839 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:27:15.840 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:27:16.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:15 smithi110 bash[22020]: audit 2024-09-21T05:27:14.829354+0000 mgr.y (mgr.25142) 112 : audit [DBG] from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:15 smithi110 bash[22020]: audit 2024-09-21T05:27:15.146222+0000 mgr.y (mgr.25142) 113 : audit [DBG] from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:15 smithi110 bash[22020]: audit 2024-09-21T05:27:15.426569+0000 mgr.y (mgr.25142) 114 : audit [DBG] from='client.25412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[26514]: audit 2024-09-21T05:27:14.829354+0000 mgr.y (mgr.25142) 112 : audit [DBG] from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[26514]: audit 2024-09-21T05:27:15.146222+0000 mgr.y (mgr.25142) 113 : audit [DBG] from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[26514]: audit 2024-09-21T05:27:15.426569+0000 mgr.y (mgr.25142) 114 : audit [DBG] from='client.25412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[19831]: audit 2024-09-21T05:27:14.829354+0000 mgr.y (mgr.25142) 112 : audit [DBG] from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[19831]: audit 2024-09-21T05:27:15.146222+0000 mgr.y (mgr.25142) 113 : audit [DBG] from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:15 smithi089 bash[19831]: audit 2024-09-21T05:27:15.426569+0000 mgr.y (mgr.25142) 114 : audit [DBG] from='client.25412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:16.160 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:27:16.161 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:27:16.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:16] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:27:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:15.838295+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.89:0/913066748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.160018+0000 mgr.y (mgr.25142) 115 : audit [DBG] from='client.15549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.538663+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.550996+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.553208+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.555035+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.564787+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: cluster 2024-09-21T05:27:16.616300+0000 mgr.y (mgr.25142) 116 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.616487+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:17.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[19831]: audit 2024-09-21T05:27:16.617484+0000 mgr.y (mgr.25142) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:15.838295+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.89:0/913066748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.160018+0000 mgr.y (mgr.25142) 115 : audit [DBG] from='client.15549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.538663+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.550996+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.553208+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.555035+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.564787+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: cluster 2024-09-21T05:27:16.616300+0000 mgr.y (mgr.25142) 116 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.616487+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:17.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:16 smithi089 bash[26514]: audit 2024-09-21T05:27:16.617484+0000 mgr.y (mgr.25142) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:15.838295+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.89:0/913066748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.160018+0000 mgr.y (mgr.25142) 115 : audit [DBG] from='client.15549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.538663+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.550996+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.553208+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.555035+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.564787+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: cluster 2024-09-21T05:27:16.616300+0000 mgr.y (mgr.25142) 116 : cluster [DBG] pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.616487+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:17.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:16 smithi110 bash[22020]: audit 2024-09-21T05:27:16.617484+0000 mgr.y (mgr.25142) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T05:27:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.701346+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.704628+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.707184+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.709939+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.712413+0000 mon.a (mon.0) 1401 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.714472+0000 mon.a (mon.0) 1402 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.716476+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.718856+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.721506+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.724910+0000 mon.a (mon.0) 1406 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[19831]: audit 2024-09-21T05:27:16.728023+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.701346+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.704628+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.707184+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.709939+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.712413+0000 mon.a (mon.0) 1401 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.714472+0000 mon.a (mon.0) 1402 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.716476+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.718856+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.721506+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.724910+0000 mon.a (mon.0) 1406 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:17 smithi089 bash[26514]: audit 2024-09-21T05:27:16.728023+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.701346+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.704628+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.707184+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.709939+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.712413+0000 mon.a (mon.0) 1401 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.714472+0000 mon.a (mon.0) 1402 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.716476+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.718856+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.721506+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.724910+0000 mon.a (mon.0) 1406 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:18.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:17 smithi110 bash[22020]: audit 2024-09-21T05:27:16.728023+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:18 smithi089 bash[19831]: audit 2024-09-21T05:27:18.046231+0000 mgr.y (mgr.25142) 118 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:18 smithi089 bash[19831]: cluster 2024-09-21T05:27:18.616708+0000 mgr.y (mgr.25142) 119 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:18 smithi089 bash[26514]: audit 2024-09-21T05:27:18.046231+0000 mgr.y (mgr.25142) 118 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:18 smithi089 bash[26514]: cluster 2024-09-21T05:27:18.616708+0000 mgr.y (mgr.25142) 119 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:18 smithi110 bash[22020]: audit 2024-09-21T05:27:18.046231+0000 mgr.y (mgr.25142) 118 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:18 smithi110 bash[22020]: cluster 2024-09-21T05:27:18.616708+0000 mgr.y (mgr.25142) 119 : cluster [DBG] pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:19 smithi089 bash[19831]: cephadm 2024-09-21T05:27:19.294348+0000 mgr.y (mgr.25142) 120 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-09-21T05:27:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:19 smithi089 bash[19831]: cephadm 2024-09-21T05:27:19.308458+0000 mgr.y (mgr.25142) 121 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:27:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:19 smithi089 bash[26514]: cephadm 2024-09-21T05:27:19.294348+0000 mgr.y (mgr.25142) 120 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-09-21T05:27:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:19 smithi089 bash[26514]: cephadm 2024-09-21T05:27:19.308458+0000 mgr.y (mgr.25142) 121 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:27:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:19 smithi110 bash[22020]: cephadm 2024-09-21T05:27:19.294348+0000 mgr.y (mgr.25142) 120 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-09-21T05:27:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:19 smithi110 bash[22020]: cephadm 2024-09-21T05:27:19.308458+0000 mgr.y (mgr.25142) 121 : cephadm [INF] Deploying daemon alertmanager.a on smithi089 2024-09-21T05:27:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:20 smithi089 bash[19831]: audit 2024-09-21T05:27:20.449311+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:20 smithi089 bash[19831]: cluster 2024-09-21T05:27:20.618265+0000 mgr.y (mgr.25142) 122 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:20 smithi089 bash[26514]: audit 2024-09-21T05:27:20.449311+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:21.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:20 smithi089 bash[26514]: cluster 2024-09-21T05:27:20.618265+0000 mgr.y (mgr.25142) 122 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:20 smithi110 bash[22020]: audit 2024-09-21T05:27:20.449311+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:20 smithi110 bash[22020]: cluster 2024-09-21T05:27:20.618265+0000 mgr.y (mgr.25142) 122 : cluster [DBG] pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:22 smithi089 bash[19831]: cluster 2024-09-21T05:27:22.618941+0000 mgr.y (mgr.25142) 123 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:22 smithi089 bash[26514]: cluster 2024-09-21T05:27:22.618941+0000 mgr.y (mgr.25142) 123 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:22 smithi110 bash[22020]: cluster 2024-09-21T05:27:22.618941+0000 mgr.y (mgr.25142) 123 : cluster [DBG] pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:24 smithi089 bash[19831]: cluster 2024-09-21T05:27:24.619630+0000 mgr.y (mgr.25142) 124 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:24 smithi089 bash[26514]: cluster 2024-09-21T05:27:24.619630+0000 mgr.y (mgr.25142) 124 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:25.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:24 smithi110 bash[22020]: cluster 2024-09-21T05:27:24.619630+0000 mgr.y (mgr.25142) 124 : cluster [DBG] pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:26.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:26] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:27:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:26 smithi089 bash[19831]: cluster 2024-09-21T05:27:26.621266+0000 mgr.y (mgr.25142) 125 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:26 smithi089 bash[26514]: cluster 2024-09-21T05:27:26.621266+0000 mgr.y (mgr.25142) 125 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:26 smithi110 bash[22020]: cluster 2024-09-21T05:27:26.621266+0000 mgr.y (mgr.25142) 125 : cluster [DBG] pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:28.297 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.298 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.298 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.298 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.299 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.299 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:28.655 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:28 smithi089 systemd[1]: Stopping Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:27:28.655 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:28 smithi089 bash[51498]: ts=2024-09-21T05:27:28.435Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:27:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:28 smithi089 bash[19831]: audit 2024-09-21T05:27:28.054117+0000 mgr.y (mgr.25142) 126 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:28 smithi089 bash[19831]: cluster 2024-09-21T05:27:28.622010+0000 mgr.y (mgr.25142) 127 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:28 smithi089 bash[26514]: audit 2024-09-21T05:27:28.054117+0000 mgr.y (mgr.25142) 126 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:28 smithi089 bash[26514]: cluster 2024-09-21T05:27:28.622010+0000 mgr.y (mgr.25142) 127 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:28 smithi110 bash[22020]: audit 2024-09-21T05:27:28.054117+0000 mgr.y (mgr.25142) 126 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:28 smithi110 bash[22020]: cluster 2024-09-21T05:27:28.622010+0000 mgr.y (mgr.25142) 127 : cluster [DBG] pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:29.496 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 bash[82227]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:27:29.496 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 bash[82287]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:27:29.496 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T05:27:29.496 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: Stopped Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:27:29.797 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.797 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.798 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.798 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: Started Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:27:29.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.798 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.798 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.799 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.799 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:29.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:29 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:27:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[19831]: audit 2024-09-21T05:27:29.668802+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[19831]: audit 2024-09-21T05:27:29.674987+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[19831]: cluster 2024-09-21T05:27:30.623558+0000 mgr.y (mgr.25142) 128 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[26514]: audit 2024-09-21T05:27:29.668802+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[26514]: audit 2024-09-21T05:27:29.674987+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[26514]: cluster 2024-09-21T05:27:30.623558+0000 mgr.y (mgr.25142) 128 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:31.048 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.818Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-21T05:27:31.048 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.818Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-21T05:27:31.048 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.820Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.89 port=9094 2024-09-21T05:27:31.049 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.821Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-21T05:27:31.049 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.849Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:27:31.049 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.849Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-21T05:27:31.049 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.851Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-21T05:27:31.049 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:30 smithi089 bash[82342]: ts=2024-09-21T05:27:30.851Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-21T05:27:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:30 smithi110 bash[22020]: audit 2024-09-21T05:27:29.668802+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:30 smithi110 bash[22020]: audit 2024-09-21T05:27:29.674987+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:31.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:30 smithi110 bash[22020]: cluster 2024-09-21T05:27:30.623558+0000 mgr.y (mgr.25142) 128 : cluster [DBG] pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:33.047 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:32 smithi089 bash[82342]: ts=2024-09-21T05:27:32.822Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00031421s 2024-09-21T05:27:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:32 smithi089 bash[19831]: cluster 2024-09-21T05:27:32.624216+0000 mgr.y (mgr.25142) 129 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:33.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:32 smithi089 bash[26514]: cluster 2024-09-21T05:27:32.624216+0000 mgr.y (mgr.25142) 129 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:32 smithi110 bash[22020]: cluster 2024-09-21T05:27:32.624216+0000 mgr.y (mgr.25142) 129 : cluster [DBG] pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:35.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:34 smithi089 bash[19831]: cluster 2024-09-21T05:27:34.624914+0000 mgr.y (mgr.25142) 130 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:34 smithi089 bash[26514]: cluster 2024-09-21T05:27:34.624914+0000 mgr.y (mgr.25142) 130 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:34 smithi110 bash[22020]: cluster 2024-09-21T05:27:34.624914+0000 mgr.y (mgr.25142) 130 : cluster [DBG] pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[19831]: audit 2024-09-21T05:27:35.449102+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[19831]: audit 2024-09-21T05:27:35.560198+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[19831]: audit 2024-09-21T05:27:35.567680+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[19831]: audit 2024-09-21T05:27:35.688196+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[26514]: audit 2024-09-21T05:27:35.449102+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:36.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[26514]: audit 2024-09-21T05:27:35.560198+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[26514]: audit 2024-09-21T05:27:35.567680+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:35 smithi089 bash[26514]: audit 2024-09-21T05:27:35.688196+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:35 smithi110 bash[22020]: audit 2024-09-21T05:27:35.449102+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:35 smithi110 bash[22020]: audit 2024-09-21T05:27:35.560198+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:35 smithi110 bash[22020]: audit 2024-09-21T05:27:35.567680+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:35 smithi110 bash[22020]: audit 2024-09-21T05:27:35.688196+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:36.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:36] "GET /metrics HTTP/1.1" 200 38224 "" "Prometheus/2.51.0" 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[19831]: audit 2024-09-21T05:27:35.696797+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[19831]: audit 2024-09-21T05:27:36.609880+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[19831]: audit 2024-09-21T05:27:36.617812+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[19831]: cluster 2024-09-21T05:27:36.626174+0000 mgr.y (mgr.25142) 131 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[26514]: audit 2024-09-21T05:27:35.696797+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[26514]: audit 2024-09-21T05:27:36.609880+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[26514]: audit 2024-09-21T05:27:36.617812+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:36 smithi089 bash[26514]: cluster 2024-09-21T05:27:36.626174+0000 mgr.y (mgr.25142) 131 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:36 smithi110 bash[22020]: audit 2024-09-21T05:27:35.696797+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:36 smithi110 bash[22020]: audit 2024-09-21T05:27:36.609880+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:36 smithi110 bash[22020]: audit 2024-09-21T05:27:36.617812+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:36 smithi110 bash[22020]: cluster 2024-09-21T05:27:36.626174+0000 mgr.y (mgr.25142) 131 : cluster [DBG] pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:38 smithi089 bash[19831]: audit 2024-09-21T05:27:38.056749+0000 mgr.y (mgr.25142) 132 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:39.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:38 smithi089 bash[19831]: cluster 2024-09-21T05:27:38.626826+0000 mgr.y (mgr.25142) 133 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:39.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:38 smithi089 bash[26514]: audit 2024-09-21T05:27:38.056749+0000 mgr.y (mgr.25142) 132 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:39.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:38 smithi089 bash[26514]: cluster 2024-09-21T05:27:38.626826+0000 mgr.y (mgr.25142) 133 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:38 smithi110 bash[22020]: audit 2024-09-21T05:27:38.056749+0000 mgr.y (mgr.25142) 132 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:38 smithi110 bash[22020]: cluster 2024-09-21T05:27:38.626826+0000 mgr.y (mgr.25142) 133 : cluster [DBG] pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:40 smithi089 bash[19831]: cluster 2024-09-21T05:27:40.628473+0000 mgr.y (mgr.25142) 134 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:41.047 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:27:40 smithi089 bash[82342]: ts=2024-09-21T05:27:40.824Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003010458s 2024-09-21T05:27:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:40 smithi089 bash[26514]: cluster 2024-09-21T05:27:40.628473+0000 mgr.y (mgr.25142) 134 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:40 smithi110 bash[22020]: cluster 2024-09-21T05:27:40.628473+0000 mgr.y (mgr.25142) 134 : cluster [DBG] pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:43.003 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:42 smithi089 bash[19831]: cluster 2024-09-21T05:27:42.629219+0000 mgr.y (mgr.25142) 135 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:43.003 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:42 smithi089 bash[26514]: cluster 2024-09-21T05:27:42.629219+0000 mgr.y (mgr.25142) 135 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:42 smithi110 bash[22020]: cluster 2024-09-21T05:27:42.629219+0000 mgr.y (mgr.25142) 135 : cluster [DBG] pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:44 smithi089 bash[19831]: cluster 2024-09-21T05:27:44.629951+0000 mgr.y (mgr.25142) 136 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:44 smithi089 bash[26514]: cluster 2024-09-21T05:27:44.629951+0000 mgr.y (mgr.25142) 136 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:44 smithi110 bash[22020]: cluster 2024-09-21T05:27:44.629951+0000 mgr.y (mgr.25142) 136 : cluster [DBG] pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:46.514 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:27:46.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:46] "GET /metrics HTTP/1.1" 200 38224 "" "Prometheus/2.51.0" 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (17s) 11s ago 27m 14.0M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (26m) 11s ago 26m 76.1M - 9.4.12 2bacad6d85d8 4107ff046569 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (2m) 11s ago 24m 47.7M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (108s) 11s ago 35m 440M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (12m) 11s ago 37m 503M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (37m) 11s ago 38m 87.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (36m) 11s ago 36m 59.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (36m) 11s ago 36m 62.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (83s) 11s ago 27m 7843k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (79s) 11s ago 27m 7772k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (34m) 11s ago 34m 58.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:27:47.147 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (34m) 11s ago 34m 68.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (33m) 11s ago 33m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (32m) 11s ago 32m 59.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (31m) 11s ago 31m 73.9M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (30m) 11s ago 30m 56.3M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (29m) 11s ago 29m 64.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (28m) 11s ago 28m 65.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (47s) 11s ago 27m 34.7M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (25m) 11s ago 25m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:27:47.148 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (25m) 11s ago 25m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:27:47.524 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:27:47.525 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.443858+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.454900+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.457051+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.458468+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.468723+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.498642+0000 mgr.y (mgr.25142) 137 : audit [DBG] from='client.15555 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:47.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.515029+0000 mon.a (mon.0) 1423 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.515758+0000 mgr.y (mgr.25142) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.557865+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.560380+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.562127+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.563907+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.565483+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.566727+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.567925+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.569456+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.571245+0000 mon.a (mon.0) 1432 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.572774+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.574227+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.443858+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.454900+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.457051+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.458468+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.468723+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.498642+0000 mgr.y (mgr.25142) 137 : audit [DBG] from='client.15555 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.515029+0000 mon.a (mon.0) 1423 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.515758+0000 mgr.y (mgr.25142) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.557865+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.560380+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.562127+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.563907+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.565483+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.566727+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.567925+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.569456+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.571245+0000 mon.a (mon.0) 1432 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.572774+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.574227+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: audit 2024-09-21T05:27:46.575658+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[26514]: cluster 2024-09-21T05:27:46.630988+0000 mgr.y (mgr.25142) 139 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: audit 2024-09-21T05:27:46.575658+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:47 smithi089 bash[19831]: cluster 2024-09-21T05:27:46.630988+0000 mgr.y (mgr.25142) 139 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.443858+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.454900+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.457051+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.458468+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.468723+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.498642+0000 mgr.y (mgr.25142) 137 : audit [DBG] from='client.15555 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.515029+0000 mon.a (mon.0) 1423 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.515758+0000 mgr.y (mgr.25142) 138 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.557865+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.560380+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.562127+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.563907+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.565483+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.566727+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.567925+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.569456+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.571245+0000 mon.a (mon.0) 1432 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.572774+0000 mon.a (mon.0) 1433 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.574227+0000 mon.a (mon.0) 1434 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: audit 2024-09-21T05:27:46.575658+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:47.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:47 smithi110 bash[22020]: cluster 2024-09-21T05:27:46.630988+0000 mgr.y (mgr.25142) 139 : cluster [DBG] pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:27:47.838 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T05:27:47.839 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:27:47.839 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:27:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:48 smithi110 bash[22020]: audit 2024-09-21T05:27:46.818042+0000 mgr.y (mgr.25142) 140 : audit [DBG] from='client.15561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:48 smithi110 bash[22020]: audit 2024-09-21T05:27:47.132761+0000 mgr.y (mgr.25142) 141 : audit [DBG] from='client.15567 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:48 smithi110 bash[22020]: audit 2024-09-21T05:27:47.523709+0000 mon.c (mon.2) 235 : audit [DBG] from='client.? 172.21.15.89:0/1890336867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[26514]: audit 2024-09-21T05:27:46.818042+0000 mgr.y (mgr.25142) 140 : audit [DBG] from='client.15561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[26514]: audit 2024-09-21T05:27:47.132761+0000 mgr.y (mgr.25142) 141 : audit [DBG] from='client.15567 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[26514]: audit 2024-09-21T05:27:47.523709+0000 mon.c (mon.2) 235 : audit [DBG] from='client.? 172.21.15.89:0/1890336867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[19831]: audit 2024-09-21T05:27:46.818042+0000 mgr.y (mgr.25142) 140 : audit [DBG] from='client.15561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[19831]: audit 2024-09-21T05:27:47.132761+0000 mgr.y (mgr.25142) 141 : audit [DBG] from='client.15567 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:48.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:48 smithi089 bash[19831]: audit 2024-09-21T05:27:47.523709+0000 mon.c (mon.2) 235 : audit [DBG] from='client.? 172.21.15.89:0/1890336867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:27:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[19831]: audit 2024-09-21T05:27:47.837445+0000 mgr.y (mgr.25142) 142 : audit [DBG] from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[19831]: audit 2024-09-21T05:27:48.068033+0000 mgr.y (mgr.25142) 143 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[19831]: cluster 2024-09-21T05:27:48.631661+0000 mgr.y (mgr.25142) 144 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:49.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[26514]: audit 2024-09-21T05:27:47.837445+0000 mgr.y (mgr.25142) 142 : audit [DBG] from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:49.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[26514]: audit 2024-09-21T05:27:48.068033+0000 mgr.y (mgr.25142) 143 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:49.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:49 smithi089 bash[26514]: cluster 2024-09-21T05:27:48.631661+0000 mgr.y (mgr.25142) 144 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:49 smithi110 bash[22020]: audit 2024-09-21T05:27:47.837445+0000 mgr.y (mgr.25142) 142 : audit [DBG] from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:27:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:49 smithi110 bash[22020]: audit 2024-09-21T05:27:48.068033+0000 mgr.y (mgr.25142) 143 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:49 smithi110 bash[22020]: cluster 2024-09-21T05:27:48.631661+0000 mgr.y (mgr.25142) 144 : cluster [DBG] pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[19831]: cephadm 2024-09-21T05:27:49.051750+0000 mgr.y (mgr.25142) 145 : cephadm [INF] Upgrade: Updating grafana.a 2024-09-21T05:27:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[19831]: cephadm 2024-09-21T05:27:49.116285+0000 mgr.y (mgr.25142) 146 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:27:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[19831]: audit 2024-09-21T05:27:50.449889+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[26514]: cephadm 2024-09-21T05:27:49.051750+0000 mgr.y (mgr.25142) 145 : cephadm [INF] Upgrade: Updating grafana.a 2024-09-21T05:27:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[26514]: cephadm 2024-09-21T05:27:49.116285+0000 mgr.y (mgr.25142) 146 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:27:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:50 smithi089 bash[26514]: audit 2024-09-21T05:27:50.449889+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:50 smithi110 bash[22020]: cephadm 2024-09-21T05:27:49.051750+0000 mgr.y (mgr.25142) 145 : cephadm [INF] Upgrade: Updating grafana.a 2024-09-21T05:27:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:50 smithi110 bash[22020]: cephadm 2024-09-21T05:27:49.116285+0000 mgr.y (mgr.25142) 146 : cephadm [INF] Deploying daemon grafana.a on smithi110 2024-09-21T05:27:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:50 smithi110 bash[22020]: audit 2024-09-21T05:27:50.449889+0000 mon.a (mon.0) 1436 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:27:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:51 smithi089 bash[19831]: cluster 2024-09-21T05:27:50.633201+0000 mgr.y (mgr.25142) 147 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:51 smithi089 bash[26514]: cluster 2024-09-21T05:27:50.633201+0000 mgr.y (mgr.25142) 147 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:51 smithi110 bash[22020]: cluster 2024-09-21T05:27:50.633201+0000 mgr.y (mgr.25142) 147 : cluster [DBG] pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:52 smithi089 bash[19831]: cluster 2024-09-21T05:27:52.633934+0000 mgr.y (mgr.25142) 148 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:52 smithi089 bash[26514]: cluster 2024-09-21T05:27:52.633934+0000 mgr.y (mgr.25142) 148 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:52 smithi110 bash[22020]: cluster 2024-09-21T05:27:52.633934+0000 mgr.y (mgr.25142) 148 : cluster [DBG] pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:54 smithi089 bash[19831]: cluster 2024-09-21T05:27:54.634674+0000 mgr.y (mgr.25142) 149 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:54 smithi089 bash[26514]: cluster 2024-09-21T05:27:54.634674+0000 mgr.y (mgr.25142) 149 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:54 smithi110 bash[22020]: cluster 2024-09-21T05:27:54.634674+0000 mgr.y (mgr.25142) 149 : cluster [DBG] pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:27:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:27:56] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.51.0" 2024-09-21T05:27:57.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:56 smithi089 bash[19831]: cluster 2024-09-21T05:27:56.636336+0000 mgr.y (mgr.25142) 150 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:56 smithi089 bash[26514]: cluster 2024-09-21T05:27:56.636336+0000 mgr.y (mgr.25142) 150 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:56 smithi110 bash[22020]: cluster 2024-09-21T05:27:56.636336+0000 mgr.y (mgr.25142) 150 : cluster [DBG] pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:27:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:58 smithi089 bash[19831]: audit 2024-09-21T05:27:58.079371+0000 mgr.y (mgr.25142) 151 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:27:58 smithi089 bash[19831]: cluster 2024-09-21T05:27:58.637025+0000 mgr.y (mgr.25142) 152 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:58 smithi089 bash[26514]: audit 2024-09-21T05:27:58.079371+0000 mgr.y (mgr.25142) 151 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:27:58 smithi089 bash[26514]: cluster 2024-09-21T05:27:58.637025+0000 mgr.y (mgr.25142) 152 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:27:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:58 smithi110 bash[22020]: audit 2024-09-21T05:27:58.079371+0000 mgr.y (mgr.25142) 151 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:27:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:27:58 smithi110 bash[22020]: cluster 2024-09-21T05:27:58.637025+0000 mgr.y (mgr.25142) 152 : cluster [DBG] pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:00 smithi089 bash[26514]: cluster 2024-09-21T05:28:00.638642+0000 mgr.y (mgr.25142) 153 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:00 smithi089 bash[19831]: cluster 2024-09-21T05:28:00.638642+0000 mgr.y (mgr.25142) 153 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:00 smithi110 bash[22020]: cluster 2024-09-21T05:28:00.638642+0000 mgr.y (mgr.25142) 153 : cluster [DBG] pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:02 smithi089 bash[26514]: cluster 2024-09-21T05:28:02.639353+0000 mgr.y (mgr.25142) 154 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:02 smithi089 bash[19831]: cluster 2024-09-21T05:28:02.639353+0000 mgr.y (mgr.25142) 154 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:02 smithi110 bash[22020]: cluster 2024-09-21T05:28:02.639353+0000 mgr.y (mgr.25142) 154 : cluster [DBG] pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:04 smithi110 bash[22020]: cluster 2024-09-21T05:28:04.640050+0000 mgr.y (mgr.25142) 155 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:04 smithi089 bash[19831]: cluster 2024-09-21T05:28:04.640050+0000 mgr.y (mgr.25142) 155 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:04 smithi089 bash[26514]: cluster 2024-09-21T05:28:04.640050+0000 mgr.y (mgr.25142) 155 : cluster [DBG] pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:05 smithi089 bash[19831]: audit 2024-09-21T05:28:05.450716+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:05 smithi089 bash[26514]: audit 2024-09-21T05:28:05.450716+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:05 smithi110 bash[22020]: audit 2024-09-21T05:28:05.450716+0000 mon.a (mon.0) 1437 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:06.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:06] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.51.0" 2024-09-21T05:28:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:06 smithi089 bash[26514]: cluster 2024-09-21T05:28:06.641708+0000 mgr.y (mgr.25142) 156 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:07.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:06 smithi089 bash[19831]: cluster 2024-09-21T05:28:06.641708+0000 mgr.y (mgr.25142) 156 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:06 smithi110 bash[22020]: cluster 2024-09-21T05:28:06.641708+0000 mgr.y (mgr.25142) 156 : cluster [DBG] pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:07.354 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.354 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.355 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.355 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.355 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.355 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.356 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.356 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.356 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:07.356 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:07 smithi110 systemd[1]: Stopping Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:28:07.356 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:07 smithi110 bash[47061]: logger=server t=2024-09-21T05:28:07.345382567Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-21T05:28:07.356 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:07 smithi110 bash[47061]: logger=ticker t=2024-09-21T05:28:07.345512901Z level=info msg=stopped last_tick=2024-09-21T05:28:00Z 2024-09-21T05:28:07.357 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:07 smithi110 bash[47061]: logger=tracing t=2024-09-21T05:28:07.34555783Z level=info msg="Closing tracing" 2024-09-21T05:28:08.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 bash[67307]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-grafana-a 2024-09-21T05:28:08.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 bash[67367]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-grafana-a 2024-09-21T05:28:08.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-21T05:28:08.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: Stopped Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:28:08.631 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.631 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.631 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: Started Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:28:08.632 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.632 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.632 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.633 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.633 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.633 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:08.633 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:28:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:28:09.796 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[22020]: audit 2024-09-21T05:28:08.090592+0000 mgr.y (mgr.25142) 157 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:09.796 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[22020]: audit 2024-09-21T05:28:08.542737+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.796 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[22020]: audit 2024-09-21T05:28:08.553309+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.796 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[22020]: cluster 2024-09-21T05:28:08.642473+0000 mgr.y (mgr.25142) 158 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.77078968Z level=info msg="Starting Grafana" version=10.4.8 commit=8c384b71bde142a25ddc01ed5a183ca572b2b7f7 branch=v10.4.x compiled=2024-09-21T05:28:09Z 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.77101702Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771026829Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771042009Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771051021Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771056729Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771062759Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771068804Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771074923Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771081308Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-21T05:28:09.797 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771087053Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771093064Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771099363Z level=info msg=Target target=[all] 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771109395Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771114954Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.77112064Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771126052Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.771131748Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=settings t=2024-09-21T05:28:09.77113743Z level=info msg="App mode production" 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=sqlstore t=2024-09-21T05:28:09.771443575Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=sqlstore t=2024-09-21T05:28:09.771462412Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.772113786Z level=info msg="Starting DB migrations" 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.791831729Z level=info msg="Executing migration" id="Add uid column to user" 2024-09-21T05:28:09.798 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.797587695Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=5.754628ms 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[19831]: audit 2024-09-21T05:28:08.090592+0000 mgr.y (mgr.25142) 157 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[19831]: audit 2024-09-21T05:28:08.542737+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[19831]: audit 2024-09-21T05:28:08.553309+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[19831]: cluster 2024-09-21T05:28:08.642473+0000 mgr.y (mgr.25142) 158 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[26514]: audit 2024-09-21T05:28:08.090592+0000 mgr.y (mgr.25142) 157 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[26514]: audit 2024-09-21T05:28:08.542737+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[26514]: audit 2024-09-21T05:28:08.553309+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:09.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:09 smithi089 bash[26514]: cluster 2024-09-21T05:28:08.642473+0000 mgr.y (mgr.25142) 158 : cluster [DBG] pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:10.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.830220781Z level=info msg="Executing migration" id="Update uid column values for users" 2024-09-21T05:28:10.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.830419726Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=198.207µs 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.85564317Z level=info msg="Executing migration" id="Add unique index user_uid" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.856501691Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=858.237µs 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.880779769Z level=info msg="Executing migration" id="update login field with orgid to allow for multiple service accounts with same name across orgs" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.881028787Z level=info msg="Migration successfully executed" id="update login field with orgid to allow for multiple service accounts with same name across orgs" duration=249.375µs 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.906488403Z level=info msg="Executing migration" id="Add playlist column created_at" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.9121224Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=5.632439ms 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.956380358Z level=info msg="Executing migration" id="Add playlist column updated_at" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.962222971Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=5.843007ms 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.989914974Z level=info msg="Executing migration" id="Add column uid in team" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:09 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:09.995698084Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=5.782047ms 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.023436421Z level=info msg="Executing migration" id="Update uid column values in team" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.023621998Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=186.076µs 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.040553613Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2024-09-21T05:28:10.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.042074357Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=1.522415ms 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.074176652Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.07515257Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=975.219µs 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.099608558Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.10579825Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=6.188807ms 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.132943739Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.138785099Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=5.840207ms 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.166556029Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.166633903Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=77.284µs 2024-09-21T05:28:10.326 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.208421629Z level=info msg="Executing migration" id="add library_element folder uid" 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.214550588Z level=info msg="Migration successfully executed" id="add library_element folder uid" duration=6.128684ms 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.242214382Z level=info msg="Executing migration" id="populate library_element folder_uid" 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.243078232Z level=info msg="Migration successfully executed" id="populate library_element folder_uid" duration=863.679µs 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.28412708Z level=info msg="Executing migration" id="add index library_element org_id-folder_uid-name-kind" 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.286669675Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_uid-name-kind" duration=2.539005ms 2024-09-21T05:28:10.327 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.326319654Z level=info msg="Executing migration" id="permission kind migration" 2024-09-21T05:28:10.602 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.34225573Z level=info msg="Migration successfully executed" id="permission kind migration" duration=15.9338ms 2024-09-21T05:28:10.602 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.367984629Z level=info msg="Executing migration" id="permission attribute migration" 2024-09-21T05:28:10.602 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.38379987Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=15.793329ms 2024-09-21T05:28:10.602 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.409932207Z level=info msg="Executing migration" id="permission identifier migration" 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.425296981Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=15.363981ms 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.468572985Z level=info msg="Executing migration" id="add permission identifier index" 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.471408682Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=2.83488ms 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.510575032Z level=info msg="Executing migration" id="add permission action scope role_id index" 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.513715574Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=3.139156ms 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.535990003Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.538260645Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=2.270375ms 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.561093305Z level=info msg="Executing migration" id="rbac disabled migrator" 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.56119117Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=98.308µs 2024-09-21T05:28:10.603 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.603130868Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2024-09-21T05:28:10.854 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.605584297Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=2.451519ms 2024-09-21T05:28:10.854 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.628320598Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2024-09-21T05:28:10.854 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.630686996Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=2.366247ms 2024-09-21T05:28:10.854 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.670366699Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2024-09-21T05:28:10.854 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.716703918Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=46.335484ms 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.762784663Z level=info msg="Executing migration" id="create correlation v2" 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.765214569Z level=info msg="Migration successfully executed" id="create correlation v2" duration=2.429056ms 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.787991907Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.790274598Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=2.282185ms 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.813156974Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2024-09-21T05:28:10.855 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.815617464Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=2.456616ms 2024-09-21T05:28:11.114 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.855201958Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.857785884Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=2.582917ms 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.880548349Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.881241622Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=695.859µs 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.922299523Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.924223897Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=1.913011ms 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.947642042Z level=info msg="Executing migration" id="add provisioning column" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:10 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:10.964242554Z level=info msg="Migration successfully executed" id="add provisioning column" duration=16.598666ms 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.006304683Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.006848205Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=539.528µs 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.031484451Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.031695071Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=204.953µs 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.073503045Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.089672594Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=16.16711ms 2024-09-21T05:28:11.115 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.115399384Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.116211598Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=811.571µs 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.140620324Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.141026202Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=405.571µs 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.165890861Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.167606871Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=1.715787ms 2024-09-21T05:28:11.367 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.191210559Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.193695421Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=2.480398ms 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.216329455Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.218620204Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=2.289862ms 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.258386105Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.259486831Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=1.102557ms 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.30029768Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.300992879Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=694.506µs 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.342305284Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.34468139Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=2.375403ms 2024-09-21T05:28:11.368 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.36758111Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.370280266Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=2.700635ms 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.392828347Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.394999037Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=2.170067ms 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.418065271Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.420315493Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=2.246242ms 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.460022679Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2024-09-21T05:28:11.652 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.462297937Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=2.274542ms 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.502010689Z level=info msg="Executing migration" id="create anon_device table" 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.503927597Z level=info msg="Migration successfully executed" id="create anon_device table" duration=1.918147ms 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.544066252Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.546308458Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=2.22137ms 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.569278082Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.570659748Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=1.38449ms 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.611222364Z level=info msg="Executing migration" id="create signing_key table" 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.612355345Z level=info msg="Migration successfully executed" id="create signing_key table" duration=1.134213ms 2024-09-21T05:28:11.653 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.653117157Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2024-09-21T05:28:11.921 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[22020]: cluster 2024-09-21T05:28:10.644073+0000 mgr.y (mgr.25142) 159 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:11.921 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.65433515Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=1.218872ms 2024-09-21T05:28:11.921 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.695285587Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.696186903Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=901.167µs 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.745862627Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.747561301Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=1.673361ms 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.788024481Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.804829521Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=16.804406ms 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.829960946Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.831635544Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=1.678177ms 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.85520591Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.855240045Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=36.239µs 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.897261839Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.899704772Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=2.442796ms 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.922500736Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2024-09-21T05:28:11.922 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.922536652Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=40.333µs 2024-09-21T05:28:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:11 smithi089 bash[19831]: cluster 2024-09-21T05:28:10.644073+0000 mgr.y (mgr.25142) 159 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:11 smithi089 bash[26514]: cluster 2024-09-21T05:28:10.644073+0000 mgr.y (mgr.25142) 159 : cluster [DBG] pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:12.198 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.947855375Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.950493291Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=2.638603ms 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.973084209Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.975844647Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=2.760285ms 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:11 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:11.998440123Z level=info msg="Executing migration" id="create sso_setting table" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.000891953Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=2.454946ms 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.023716554Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.025875428Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=2.161431ms 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.048852012Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.050239181Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=1.372109ms 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.115868041Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.116031855Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=165.988µs 2024-09-21T05:28:12.199 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.141023732Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2024-09-21T05:28:12.200 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.158013959Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=16.989483ms 2024-09-21T05:28:12.200 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.199664369Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2024-09-21T05:28:12.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.216384129Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=16.718888ms 2024-09-21T05:28:12.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.258233579Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2024-09-21T05:28:12.451 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.258998304Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=761.435µs 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=migrator t=2024-09-21T05:28:12.283416571Z level=info msg="migrations completed" performed=69 skipped=482 duration=2.491638304s 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=sqlstore t=2024-09-21T05:28:12.285753605Z level=info msg="Created default organization" 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=secrets t=2024-09-21T05:28:12.325462327Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=plugin.store t=2024-09-21T05:28:12.36814056Z level=info msg="Loading plugins..." 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=local.finder t=2024-09-21T05:28:12.439473113Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=plugin.store t=2024-09-21T05:28:12.439589591Z level=info msg="Plugins loaded" count=55 duration=71.447361ms 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=query_data t=2024-09-21T05:28:12.44709169Z level=info msg="Query Service initialization" 2024-09-21T05:28:12.452 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=live.push_http t=2024-09-21T05:28:12.45243961Z level=info msg="Live Push Gateway initialization" 2024-09-21T05:28:12.754 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.migration t=2024-09-21T05:28:12.500704556Z level=info msg=Starting 2024-09-21T05:28:12.754 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.state.manager t=2024-09-21T05:28:12.561764979Z level=info msg="Running in alternative execution of Error/NoData mode" 2024-09-21T05:28:12.754 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=infra.usagestats.collector t=2024-09-21T05:28:12.565849256Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-21T05:28:12.754 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.datasources t=2024-09-21T05:28:12.609881096Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-09-21T05:28:12.755 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.datasources t=2024-09-21T05:28:12.610763703Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-21T05:28:13.010 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.alerting t=2024-09-21T05:28:12.755471799Z level=info msg="starting to provision alerting" 2024-09-21T05:28:13.010 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.alerting t=2024-09-21T05:28:12.755521731Z level=info msg="finished to provision alerting" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.state.manager t=2024-09-21T05:28:12.755869856Z level=info msg="Warming state cache for startup" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.multiorg.alertmanager t=2024-09-21T05:28:12.756864027Z level=info msg="Starting MultiOrg Alertmanager" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=grafanaStorageLogger t=2024-09-21T05:28:12.757794786Z level=info msg="Storage starting" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=http.server t=2024-09-21T05:28:12.761139961Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=http.server t=2024-09-21T05:28:12.761450903Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.dashboard t=2024-09-21T05:28:12.788361783Z level=info msg="starting to provision dashboards" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=plugins.update.checker t=2024-09-21T05:28:12.835675906Z level=info msg="Update check succeeded" duration=78.454888ms 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=grafana.update.checker t=2024-09-21T05:28:12.843504688Z level=info msg="Update check succeeded" duration=87.5765ms 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.state.manager t=2024-09-21T05:28:12.872999889Z level=info msg="State cache has been initialized" states=0 duration=117.128534ms 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ngalert.scheduler t=2024-09-21T05:28:12.873051118Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=ticker t=2024-09-21T05:28:12.873139517Z level=info msg=starting first_tick=2024-09-21T05:28:20Z 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:12.877662594Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:12 smithi110 bash[67424]: logger=sqlstore.transactions t=2024-09-21T05:28:12.947200307Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-21T05:28:13.011 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:13 smithi110 bash[67424]: logger=provisioning.dashboard t=2024-09-21T05:28:13.011416292Z level=info msg="finished to provision dashboards" 2024-09-21T05:28:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:13 smithi110 bash[67424]: logger=grafana-apiserver t=2024-09-21T05:28:13.043108361Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2024-09-21T05:28:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:13 smithi110 bash[67424]: logger=grafana-apiserver t=2024-09-21T05:28:13.043846067Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2024-09-21T05:28:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:13 smithi089 bash[19831]: cluster 2024-09-21T05:28:12.644792+0000 mgr.y (mgr.25142) 160 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:13 smithi089 bash[26514]: cluster 2024-09-21T05:28:12.644792+0000 mgr.y (mgr.25142) 160 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:13 smithi110 bash[22020]: cluster 2024-09-21T05:28:12.644792+0000 mgr.y (mgr.25142) 160 : cluster [DBG] pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:15.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:15 smithi089 bash[19831]: audit 2024-09-21T05:28:14.487291+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:15.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:15 smithi089 bash[19831]: audit 2024-09-21T05:28:14.500271+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:15.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:15 smithi089 bash[26514]: audit 2024-09-21T05:28:14.487291+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:15.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:15 smithi089 bash[26514]: audit 2024-09-21T05:28:14.500271+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:15 smithi110 bash[22020]: audit 2024-09-21T05:28:14.487291+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:15.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:15 smithi110 bash[22020]: audit 2024-09-21T05:28:14.500271+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:16.043472648Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:16.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:16] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.51.0" 2024-09-21T05:28:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[19831]: cluster 2024-09-21T05:28:14.645476+0000 mgr.y (mgr.25142) 161 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[19831]: audit 2024-09-21T05:28:15.647815+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[19831]: audit 2024-09-21T05:28:15.658191+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[26514]: cluster 2024-09-21T05:28:14.645476+0000 mgr.y (mgr.25142) 161 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[26514]: audit 2024-09-21T05:28:15.647815+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:16 smithi089 bash[26514]: audit 2024-09-21T05:28:15.658191+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:16 smithi110 bash[22020]: cluster 2024-09-21T05:28:14.645476+0000 mgr.y (mgr.25142) 161 : cluster [DBG] pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:16 smithi110 bash[22020]: audit 2024-09-21T05:28:15.647815+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:16 smithi110 bash[22020]: audit 2024-09-21T05:28:15.658191+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:17 smithi089 bash[19831]: cluster 2024-09-21T05:28:16.647387+0000 mgr.y (mgr.25142) 162 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:17 smithi089 bash[26514]: cluster 2024-09-21T05:28:16.647387+0000 mgr.y (mgr.25142) 162 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:17 smithi110 bash[22020]: cluster 2024-09-21T05:28:16.647387+0000 mgr.y (mgr.25142) 162 : cluster [DBG] pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:18.187 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (49s) 43s ago 27m 14.0M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (10s) 4s ago 27m 32.1M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (2m) 43s ago 25m 47.7M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (2m) 4s ago 36m 440M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (13m) 43s ago 38m 503M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (38m) 43s ago 38m 87.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (36m) 4s ago 36m 60.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:28:18.847 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (36m) 43s ago 36m 62.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (115s) 43s ago 27m 7843k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (111s) 4s ago 27m 7860k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (35m) 43s ago 35m 58.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (34m) 43s ago 34m 68.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (33m) 43s ago 33m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (32m) 43s ago 32m 59.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (31m) 4s ago 31m 74.0M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (30m) 4s ago 30m 56.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (30m) 4s ago 30m 64.5M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (29m) 4s ago 29m 65.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (79s) 4s ago 28m 35.3M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (25m) 43s ago 25m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:28:18.848 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (25m) 4s ago 25m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[26514]: audit 2024-09-21T05:28:18.101832+0000 mgr.y (mgr.25142) 163 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[26514]: audit 2024-09-21T05:28:18.173285+0000 mgr.y (mgr.25142) 164 : audit [DBG] from='client.15585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[26514]: audit 2024-09-21T05:28:18.495922+0000 mgr.y (mgr.25142) 165 : audit [DBG] from='client.25466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[19831]: audit 2024-09-21T05:28:18.101832+0000 mgr.y (mgr.25142) 163 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[19831]: audit 2024-09-21T05:28:18.173285+0000 mgr.y (mgr.25142) 164 : audit [DBG] from='client.15585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:18 smithi089 bash[19831]: audit 2024-09-21T05:28:18.495922+0000 mgr.y (mgr.25142) 165 : audit [DBG] from='client.25466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:18 smithi110 bash[22020]: audit 2024-09-21T05:28:18.101832+0000 mgr.y (mgr.25142) 163 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:18 smithi110 bash[22020]: audit 2024-09-21T05:28:18.173285+0000 mgr.y (mgr.25142) 164 : audit [DBG] from='client.15585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:18 smithi110 bash[22020]: audit 2024-09-21T05:28:18.495922+0000 mgr.y (mgr.25142) 165 : audit [DBG] from='client.25466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:19.209 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:28:19.210 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:28:19.211 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-21T05:28:19.510 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-21T05:28:19.511 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T05:28:19.511 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T05:28:19.511 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:28:19.511 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:28:19.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:19.062951504Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[19831]: cluster 2024-09-21T05:28:18.648071+0000 mgr.y (mgr.25142) 166 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[19831]: audit 2024-09-21T05:28:18.809062+0000 mgr.y (mgr.25142) 167 : audit [DBG] from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[19831]: audit 2024-09-21T05:28:19.209173+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.89:0/1385333952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[19831]: audit 2024-09-21T05:28:19.509670+0000 mgr.y (mgr.25142) 168 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[26514]: cluster 2024-09-21T05:28:18.648071+0000 mgr.y (mgr.25142) 166 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[26514]: audit 2024-09-21T05:28:18.809062+0000 mgr.y (mgr.25142) 167 : audit [DBG] from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[26514]: audit 2024-09-21T05:28:19.209173+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.89:0/1385333952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:20.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:19 smithi089 bash[26514]: audit 2024-09-21T05:28:19.509670+0000 mgr.y (mgr.25142) 168 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:19 smithi110 bash[22020]: cluster 2024-09-21T05:28:18.648071+0000 mgr.y (mgr.25142) 166 : cluster [DBG] pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:19 smithi110 bash[22020]: audit 2024-09-21T05:28:18.809062+0000 mgr.y (mgr.25142) 167 : audit [DBG] from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:19 smithi110 bash[22020]: audit 2024-09-21T05:28:19.209173+0000 mon.a (mon.0) 1444 : audit [DBG] from='client.? 172.21.15.89:0/1385333952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:19 smithi110 bash[22020]: audit 2024-09-21T05:28:19.509670+0000 mgr.y (mgr.25142) 168 : audit [DBG] from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:20 smithi089 bash[19831]: audit 2024-09-21T05:28:20.451038+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:20 smithi089 bash[26514]: audit 2024-09-21T05:28:20.451038+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:20 smithi110 bash[22020]: audit 2024-09-21T05:28:20.451038+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:22.000 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:21 smithi110 bash[22020]: cluster 2024-09-21T05:28:20.649727+0000 mgr.y (mgr.25142) 169 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:21 smithi089 bash[19831]: cluster 2024-09-21T05:28:20.649727+0000 mgr.y (mgr.25142) 169 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:21 smithi089 bash[26514]: cluster 2024-09-21T05:28:20.649727+0000 mgr.y (mgr.25142) 169 : cluster [DBG] pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:22.019042913Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:24.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:23 smithi089 bash[19831]: cluster 2024-09-21T05:28:22.650397+0000 mgr.y (mgr.25142) 170 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:24.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:23 smithi089 bash[26514]: cluster 2024-09-21T05:28:22.650397+0000 mgr.y (mgr.25142) 170 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:24.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:23 smithi110 bash[22020]: cluster 2024-09-21T05:28:22.650397+0000 mgr.y (mgr.25142) 170 : cluster [DBG] pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:25.031047077Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:26.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:26] "GET /metrics HTTP/1.1" 200 38240 "" "Prometheus/2.51.0" 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: cluster 2024-09-21T05:28:24.651090+0000 mgr.y (mgr.25142) 171 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.362123+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.373119+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.375299+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.376877+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.387010+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.440394+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.441390+0000 mgr.y (mgr.25142) 172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.526042+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.529379+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.532332+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.535295+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.537963+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.540325+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.542973+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.546524+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.550711+0000 mon.a (mon.0) 1460 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.554411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.557810+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: cluster 2024-09-21T05:28:24.651090+0000 mgr.y (mgr.25142) 171 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.362123+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.373119+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.375299+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.376877+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.387010+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.440394+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.441390+0000 mgr.y (mgr.25142) 172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.526042+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.529379+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.532332+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.535295+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.537963+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.540325+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.542973+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.546524+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.550711+0000 mon.a (mon.0) 1460 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.554411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.557810+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.561027+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.564462+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.567610+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.570676+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: cephadm 2024-09-21T05:28:25.572355+0000 mgr.y (mgr.25142) 173 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.579874+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.586806+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:28:26.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.596160+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.601730+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.608094+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.611931+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.616472+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.619110+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.620448+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.627016+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.630990+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.632439+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.640622+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.646049+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.647447+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.655373+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.660405+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.661908+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:28:26.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.669720+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.674966+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.681368+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.686350+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.687767+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.689185+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.690644+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.691923+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.693143+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.695054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.701385+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.561027+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.564462+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.553 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.567610+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.570676+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: cephadm 2024-09-21T05:28:25.572355+0000 mgr.y (mgr.25142) 173 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.579874+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.586806+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.596160+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.601730+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.608094+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.611931+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.616472+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.619110+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.620448+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:28:26.554 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.627016+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.630990+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.632439+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.640622+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.703392+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.705172+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.716396+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.809212+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.810453+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[19831]: audit 2024-09-21T05:28:25.820526+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.556 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.646049+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.556 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.647447+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.655373+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.660405+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.661908+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.669720+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.674966+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.681368+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.686350+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.687767+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.689185+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.690644+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.691923+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.693143+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.695054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:28:26.557 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.701385+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.703392+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.705172+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.716396+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.809212+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.810453+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.558 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:26 smithi089 bash[26514]: audit 2024-09-21T05:28:25.820526+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: cluster 2024-09-21T05:28:24.651090+0000 mgr.y (mgr.25142) 171 : cluster [DBG] pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:26.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.362123+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.373119+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.375299+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.376877+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.387010+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.440394+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.441390+0000 mgr.y (mgr.25142) 172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.526042+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:28:26.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.529379+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.532332+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.535295+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.537963+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.540325+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.542973+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.546524+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.550711+0000 mon.a (mon.0) 1460 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.554411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.557810+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.561027+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.564462+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.567610+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.570676+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: cephadm 2024-09-21T05:28:25.572355+0000 mgr.y (mgr.25142) 173 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.579874+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.586806+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.596160+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.601730+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.608094+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:28:26.808 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.611931+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.616472+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.619110+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.620448+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.627016+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.630990+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.632439+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.640622+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:28:26.809 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.646049+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.647447+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.655373+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.660405+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.661908+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.669720+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.674966+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.681368+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.686350+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.687767+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.689185+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.690644+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.691923+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.693143+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:28:26.810 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.695054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.701385+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.703392+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.705172+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.716396+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.809212+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.810453+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:28:26.811 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:26 smithi110 bash[22020]: audit 2024-09-21T05:28:25.820526+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:27.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:27 smithi089 bash[19831]: cephadm 2024-09-21T05:28:25.694214+0000 mgr.y (mgr.25142) 174 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:28:27.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:27 smithi089 bash[26514]: cephadm 2024-09-21T05:28:25.694214+0000 mgr.y (mgr.25142) 174 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:28:27.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:27 smithi110 bash[22020]: cephadm 2024-09-21T05:28:25.694214+0000 mgr.y (mgr.25142) 174 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:28:28.372 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:28.066660916Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:28 smithi089 bash[19831]: cluster 2024-09-21T05:28:26.652646+0000 mgr.y (mgr.25142) 175 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:28 smithi089 bash[26514]: cluster 2024-09-21T05:28:26.652646+0000 mgr.y (mgr.25142) 175 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:28 smithi110 bash[22020]: cluster 2024-09-21T05:28:26.652646+0000 mgr.y (mgr.25142) 175 : cluster [DBG] pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:29 smithi089 bash[19831]: audit 2024-09-21T05:28:28.113060+0000 mgr.y (mgr.25142) 176 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:29 smithi089 bash[26514]: audit 2024-09-21T05:28:28.113060+0000 mgr.y (mgr.25142) 176 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:29 smithi110 bash[22020]: audit 2024-09-21T05:28:28.113060+0000 mgr.y (mgr.25142) 176 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:30 smithi089 bash[19831]: cluster 2024-09-21T05:28:28.653334+0000 mgr.y (mgr.25142) 177 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:30 smithi089 bash[26514]: cluster 2024-09-21T05:28:28.653334+0000 mgr.y (mgr.25142) 177 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:30 smithi110 bash[22020]: cluster 2024-09-21T05:28:28.653334+0000 mgr.y (mgr.25142) 177 : cluster [DBG] pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:31.038662031Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:31.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:31 smithi089 bash[19831]: audit 2024-09-21T05:28:30.519589+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:31.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:31 smithi089 bash[26514]: audit 2024-09-21T05:28:30.519589+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:31 smithi110 bash[22020]: audit 2024-09-21T05:28:30.519589+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:28:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:32 smithi089 bash[19831]: cluster 2024-09-21T05:28:30.654935+0000 mgr.y (mgr.25142) 178 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:32.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:32 smithi089 bash[26514]: cluster 2024-09-21T05:28:30.654935+0000 mgr.y (mgr.25142) 178 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:32 smithi110 bash[22020]: cluster 2024-09-21T05:28:30.654935+0000 mgr.y (mgr.25142) 178 : cluster [DBG] pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:34.033464614Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:34.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:34 smithi089 bash[19831]: cluster 2024-09-21T05:28:32.655646+0000 mgr.y (mgr.25142) 179 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:34 smithi089 bash[26514]: cluster 2024-09-21T05:28:32.655646+0000 mgr.y (mgr.25142) 179 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:34 smithi110 bash[22020]: cluster 2024-09-21T05:28:32.655646+0000 mgr.y (mgr.25142) 179 : cluster [DBG] pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:35.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:35 smithi089 bash[19831]: audit 2024-09-21T05:28:35.451204+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:35.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:35 smithi089 bash[26514]: audit 2024-09-21T05:28:35.451204+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:35 smithi110 bash[22020]: audit 2024-09-21T05:28:35.451204+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:36] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.51.0" 2024-09-21T05:28:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:36 smithi089 bash[19831]: cluster 2024-09-21T05:28:34.656340+0000 mgr.y (mgr.25142) 180 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:36 smithi089 bash[26514]: cluster 2024-09-21T05:28:34.656340+0000 mgr.y (mgr.25142) 180 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:36 smithi110 bash[22020]: cluster 2024-09-21T05:28:34.656340+0000 mgr.y (mgr.25142) 180 : cluster [DBG] pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:37.042132409Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:38 smithi110 bash[22020]: cluster 2024-09-21T05:28:36.657994+0000 mgr.y (mgr.25142) 181 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:38 smithi089 bash[19831]: cluster 2024-09-21T05:28:36.657994+0000 mgr.y (mgr.25142) 181 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:38 smithi089 bash[26514]: cluster 2024-09-21T05:28:36.657994+0000 mgr.y (mgr.25142) 181 : cluster [DBG] pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:40.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:39 smithi110 bash[22020]: audit 2024-09-21T05:28:38.124353+0000 mgr.y (mgr.25142) 182 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:39 smithi089 bash[19831]: audit 2024-09-21T05:28:38.124353+0000 mgr.y (mgr.25142) 182 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:39 smithi089 bash[26514]: audit 2024-09-21T05:28:38.124353+0000 mgr.y (mgr.25142) 182 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:40.023300974Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:40 smithi089 bash[19831]: cluster 2024-09-21T05:28:38.658694+0000 mgr.y (mgr.25142) 183 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:40 smithi089 bash[26514]: cluster 2024-09-21T05:28:38.658694+0000 mgr.y (mgr.25142) 183 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:40 smithi110 bash[22020]: cluster 2024-09-21T05:28:38.658694+0000 mgr.y (mgr.25142) 183 : cluster [DBG] pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:42 smithi089 bash[19831]: cluster 2024-09-21T05:28:40.660275+0000 mgr.y (mgr.25142) 184 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:42 smithi089 bash[26514]: cluster 2024-09-21T05:28:40.660275+0000 mgr.y (mgr.25142) 184 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:42 smithi110 bash[22020]: cluster 2024-09-21T05:28:40.660275+0000 mgr.y (mgr.25142) 184 : cluster [DBG] pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:43.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:43.061929787Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:44 smithi089 bash[19831]: cluster 2024-09-21T05:28:42.661041+0000 mgr.y (mgr.25142) 185 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:44 smithi089 bash[26514]: cluster 2024-09-21T05:28:42.661041+0000 mgr.y (mgr.25142) 185 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:44 smithi110 bash[22020]: cluster 2024-09-21T05:28:42.661041+0000 mgr.y (mgr.25142) 185 : cluster [DBG] pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:46.034302738Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:46.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:46] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.51.0" 2024-09-21T05:28:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:46 smithi089 bash[19831]: cluster 2024-09-21T05:28:44.661892+0000 mgr.y (mgr.25142) 186 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:46 smithi089 bash[26514]: cluster 2024-09-21T05:28:44.661892+0000 mgr.y (mgr.25142) 186 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:46 smithi110 bash[22020]: cluster 2024-09-21T05:28:44.661892+0000 mgr.y (mgr.25142) 186 : cluster [DBG] pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:49.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:48 smithi110 bash[22020]: cluster 2024-09-21T05:28:46.663583+0000 mgr.y (mgr.25142) 187 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:49.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:48 smithi089 bash[19831]: cluster 2024-09-21T05:28:46.663583+0000 mgr.y (mgr.25142) 187 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:48 smithi089 bash[26514]: cluster 2024-09-21T05:28:46.663583+0000 mgr.y (mgr.25142) 187 : cluster [DBG] pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:49.030626242Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:49.854 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:49 smithi089 bash[19831]: audit 2024-09-21T05:28:48.135574+0000 mgr.y (mgr.25142) 188 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:49.855 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:49 smithi089 bash[26514]: audit 2024-09-21T05:28:48.135574+0000 mgr.y (mgr.25142) 188 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:49 smithi110 bash[22020]: audit 2024-09-21T05:28:48.135574+0000 mgr.y (mgr.25142) 188 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:28:50.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T05:28:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:50 smithi089 bash[19831]: cluster 2024-09-21T05:28:48.664313+0000 mgr.y (mgr.25142) 189 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:50 smithi089 bash[19831]: audit 2024-09-21T05:28:50.451972+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:50 smithi089 bash[26514]: cluster 2024-09-21T05:28:48.664313+0000 mgr.y (mgr.25142) 189 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:50 smithi089 bash[26514]: audit 2024-09-21T05:28:50.451972+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:50 smithi110 bash[22020]: cluster 2024-09-21T05:28:48.664313+0000 mgr.y (mgr.25142) 189 : cluster [DBG] pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:50 smithi110 bash[22020]: audit 2024-09-21T05:28:50.451972+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:28:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:51 smithi089 bash[19831]: audit 2024-09-21T05:28:49.841015+0000 mgr.y (mgr.25142) 190 : audit [DBG] from='client.25490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:51 smithi089 bash[26514]: audit 2024-09-21T05:28:49.841015+0000 mgr.y (mgr.25142) 190 : audit [DBG] from='client.25490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:52.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:51 smithi110 bash[22020]: audit 2024-09-21T05:28:49.841015+0000 mgr.y (mgr.25142) 190 : audit [DBG] from='client.25490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:28:52.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:52.062672123Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:52 smithi089 bash[19831]: cluster 2024-09-21T05:28:50.665925+0000 mgr.y (mgr.25142) 191 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:52 smithi089 bash[26514]: cluster 2024-09-21T05:28:50.665925+0000 mgr.y (mgr.25142) 191 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:52 smithi110 bash[22020]: cluster 2024-09-21T05:28:50.665925+0000 mgr.y (mgr.25142) 191 : cluster [DBG] pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:55.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:54 smithi110 bash[22020]: cluster 2024-09-21T05:28:52.666572+0000 mgr.y (mgr.25142) 192 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:54 smithi089 bash[19831]: cluster 2024-09-21T05:28:52.666572+0000 mgr.y (mgr.25142) 192 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:54 smithi089 bash[26514]: cluster 2024-09-21T05:28:52.666572+0000 mgr.y (mgr.25142) 192 : cluster [DBG] pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:55.029895724Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:55.333 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:28:56.452 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:28:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:28:56] "GET /metrics HTTP/1.1" 200 38237 "" "Prometheus/2.51.0" 2024-09-21T05:28:56.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:56 smithi089 bash[19831]: cluster 2024-09-21T05:28:54.667331+0000 mgr.y (mgr.25142) 193 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:56.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:56 smithi089 bash[26514]: cluster 2024-09-21T05:28:54.667331+0000 mgr.y (mgr.25142) 193 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:56.868 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:28:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:56 smithi110 bash[22020]: cluster 2024-09-21T05:28:54.667331+0000 mgr.y (mgr.25142) 193 : cluster [DBG] pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:28:57.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T05:28:58.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:57 smithi110 bash[22020]: audit 2024-09-21T05:28:56.856941+0000 mon.a (mon.0) 1505 : audit [DBG] from='client.? 172.21.15.89:0/11830731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:57 smithi089 bash[19831]: audit 2024-09-21T05:28:56.856941+0000 mon.a (mon.0) 1505 : audit [DBG] from='client.? 172.21.15.89:0/11830731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:57 smithi089 bash[26514]: audit 2024-09-21T05:28:56.856941+0000 mon.a (mon.0) 1505 : audit [DBG] from='client.? 172.21.15.89:0/11830731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:28:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:28:58.027325932Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:28:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:58 smithi089 bash[19831]: cluster 2024-09-21T05:28:56.668891+0000 mgr.y (mgr.25142) 194 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:58 smithi089 bash[26514]: cluster 2024-09-21T05:28:56.668891+0000 mgr.y (mgr.25142) 194 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:58 smithi110 bash[22020]: cluster 2024-09-21T05:28:56.668891+0000 mgr.y (mgr.25142) 194 : cluster [DBG] pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:28:59.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:28:58 smithi110 bash[67424]: logger=infra.usagestats t=2024-09-21T05:28:58.774672053Z level=info msg="Usage stats are ready to report" 2024-09-21T05:29:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:28:59 smithi089 bash[26514]: audit 2024-09-21T05:28:58.138244+0000 mgr.y (mgr.25142) 195 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:28:59 smithi089 bash[19831]: audit 2024-09-21T05:28:58.138244+0000 mgr.y (mgr.25142) 195 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:28:59 smithi110 bash[22020]: audit 2024-09-21T05:28:58.138244+0000 mgr.y (mgr.25142) 195 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:00 smithi089 bash[19831]: cluster 2024-09-21T05:28:58.669593+0000 mgr.y (mgr.25142) 196 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:00 smithi089 bash[26514]: cluster 2024-09-21T05:28:58.669593+0000 mgr.y (mgr.25142) 196 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:00 smithi110 bash[22020]: cluster 2024-09-21T05:28:58.669593+0000 mgr.y (mgr.25142) 196 : cluster [DBG] pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:01.050293575Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:02.479 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:02 smithi089 bash[19831]: cluster 2024-09-21T05:29:00.671239+0000 mgr.y (mgr.25142) 197 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:02 smithi089 bash[26514]: cluster 2024-09-21T05:29:00.671239+0000 mgr.y (mgr.25142) 197 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:02 smithi110 bash[22020]: cluster 2024-09-21T05:29:00.671239+0000 mgr.y (mgr.25142) 197 : cluster [DBG] pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:04.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)" 2024-09-21T05:29:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:04.045149307Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:04.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:04 smithi089 bash[19831]: cluster 2024-09-21T05:29:02.671902+0000 mgr.y (mgr.25142) 198 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:04.924 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:04 smithi089 bash[19831]: audit 2024-09-21T05:29:04.259438+0000 mon.c (mon.2) 236 : audit [DBG] from='client.? 172.21.15.89:0/3440313573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:04.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:04 smithi089 bash[26514]: cluster 2024-09-21T05:29:02.671902+0000 mgr.y (mgr.25142) 198 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:04.925 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:04 smithi089 bash[26514]: audit 2024-09-21T05:29:04.259438+0000 mon.c (mon.2) 236 : audit [DBG] from='client.? 172.21.15.89:0/3440313573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:04.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T05:29:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:04 smithi110 bash[22020]: cluster 2024-09-21T05:29:02.671902+0000 mgr.y (mgr.25142) 198 : cluster [DBG] pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:04 smithi110 bash[22020]: audit 2024-09-21T05:29:04.259438+0000 mon.c (mon.2) 236 : audit [DBG] from='client.? 172.21.15.89:0/3440313573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:05 smithi089 bash[19831]: cluster 2024-09-21T05:29:04.672616+0000 mgr.y (mgr.25142) 199 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:05 smithi089 bash[19831]: audit 2024-09-21T05:29:05.452117+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:05 smithi089 bash[26514]: cluster 2024-09-21T05:29:04.672616+0000 mgr.y (mgr.25142) 199 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:05 smithi089 bash[26514]: audit 2024-09-21T05:29:05.452117+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:05 smithi110 bash[22020]: cluster 2024-09-21T05:29:04.672616+0000 mgr.y (mgr.25142) 199 : cluster [DBG] pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:05 smithi110 bash[22020]: audit 2024-09-21T05:29:05.452117+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:06.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:06] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.51.0" 2024-09-21T05:29:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:07.044320728Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:07 smithi089 bash[19831]: cluster 2024-09-21T05:29:06.674305+0000 mgr.y (mgr.25142) 200 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:07 smithi089 bash[26514]: cluster 2024-09-21T05:29:06.674305+0000 mgr.y (mgr.25142) 200 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:07 smithi110 bash[22020]: cluster 2024-09-21T05:29:06.674305+0000 mgr.y (mgr.25142) 200 : cluster [DBG] pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:08 smithi089 bash[19831]: audit 2024-09-21T05:29:08.149473+0000 mgr.y (mgr.25142) 201 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:08 smithi089 bash[26514]: audit 2024-09-21T05:29:08.149473+0000 mgr.y (mgr.25142) 201 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:08 smithi110 bash[22020]: audit 2024-09-21T05:29:08.149473+0000 mgr.y (mgr.25142) 201 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:09.737 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:10.031 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:09 smithi110 bash[22020]: cluster 2024-09-21T05:29:08.675001+0000 mgr.y (mgr.25142) 202 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:09 smithi089 bash[19831]: cluster 2024-09-21T05:29:08.675001+0000 mgr.y (mgr.25142) 202 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:09 smithi089 bash[26514]: cluster 2024-09-21T05:29:08.675001+0000 mgr.y (mgr.25142) 202 : cluster [DBG] pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:10.032991365Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:11.327 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:29:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:11 smithi089 bash[19831]: cluster 2024-09-21T05:29:10.676534+0000 mgr.y (mgr.25142) 203 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:11 smithi089 bash[19831]: audit 2024-09-21T05:29:11.314982+0000 mon.a (mon.0) 1507 : audit [DBG] from='client.? 172.21.15.89:0/1118093738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:11 smithi089 bash[26514]: cluster 2024-09-21T05:29:10.676534+0000 mgr.y (mgr.25142) 203 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:11 smithi089 bash[26514]: audit 2024-09-21T05:29:11.314982+0000 mon.a (mon.0) 1507 : audit [DBG] from='client.? 172.21.15.89:0/1118093738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:11 smithi110 bash[22020]: cluster 2024-09-21T05:29:10.676534+0000 mgr.y (mgr.25142) 203 : cluster [DBG] pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:11 smithi110 bash[22020]: audit 2024-09-21T05:29:11.314982+0000 mon.a (mon.0) 1507 : audit [DBG] from='client.? 172.21.15.89:0/1118093738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:12.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T05:29:13.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:13.074758037Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:13 smithi089 bash[19831]: cluster 2024-09-21T05:29:12.677262+0000 mgr.y (mgr.25142) 204 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:13 smithi089 bash[26514]: cluster 2024-09-21T05:29:12.677262+0000 mgr.y (mgr.25142) 204 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:13 smithi110 bash[22020]: cluster 2024-09-21T05:29:12.677262+0000 mgr.y (mgr.25142) 204 : cluster [DBG] pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:15 smithi089 bash[19831]: cluster 2024-09-21T05:29:14.678008+0000 mgr.y (mgr.25142) 205 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:15 smithi089 bash[26514]: cluster 2024-09-21T05:29:14.678008+0000 mgr.y (mgr.25142) 205 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:16.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:15 smithi110 bash[22020]: cluster 2024-09-21T05:29:14.678008+0000 mgr.y (mgr.25142) 205 : cluster [DBG] pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:16.053845475Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:16.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:16] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.51.0" 2024-09-21T05:29:16.870 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:18.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:17 smithi089 bash[19831]: cluster 2024-09-21T05:29:16.679688+0000 mgr.y (mgr.25142) 206 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:17 smithi089 bash[26514]: cluster 2024-09-21T05:29:16.679688+0000 mgr.y (mgr.25142) 206 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:17 smithi110 bash[22020]: cluster 2024-09-21T05:29:16.679688+0000 mgr.y (mgr.25142) 206 : cluster [DBG] pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:18 smithi089 bash[19831]: audit 2024-09-21T05:29:18.159822+0000 mgr.y (mgr.25142) 207 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:18 smithi089 bash[19831]: audit 2024-09-21T05:29:18.445983+0000 mgr.y (mgr.25142) 208 : audit [DBG] from='client.25514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:18 smithi089 bash[26514]: audit 2024-09-21T05:29:18.159822+0000 mgr.y (mgr.25142) 207 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:18 smithi089 bash[26514]: audit 2024-09-21T05:29:18.445983+0000 mgr.y (mgr.25142) 208 : audit [DBG] from='client.25514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:18 smithi110 bash[22020]: audit 2024-09-21T05:29:18.159822+0000 mgr.y (mgr.25142) 207 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:18 smithi110 bash[22020]: audit 2024-09-21T05:29:18.445983+0000 mgr.y (mgr.25142) 208 : audit [DBG] from='client.25514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:19.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:19.061012631Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:20.035 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:19 smithi089 bash[19831]: cluster 2024-09-21T05:29:18.680355+0000 mgr.y (mgr.25142) 209 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:20.035 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:19 smithi089 bash[26514]: cluster 2024-09-21T05:29:18.680355+0000 mgr.y (mgr.25142) 209 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:19 smithi110 bash[22020]: cluster 2024-09-21T05:29:18.680355+0000 mgr.y (mgr.25142) 209 : cluster [DBG] pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:20.880 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:29:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:20 smithi089 bash[19831]: audit 2024-09-21T05:29:20.452663+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:21.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:20 smithi089 bash[26514]: audit 2024-09-21T05:29:20.452663+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:20 smithi110 bash[22020]: audit 2024-09-21T05:29:20.452663+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:21.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:29:22.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:21 smithi089 bash[19831]: cluster 2024-09-21T05:29:20.681873+0000 mgr.y (mgr.25142) 210 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:22.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:21 smithi089 bash[26514]: cluster 2024-09-21T05:29:20.681873+0000 mgr.y (mgr.25142) 210 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:22.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:22.034672064Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:21 smithi110 bash[22020]: cluster 2024-09-21T05:29:20.681873+0000 mgr.y (mgr.25142) 210 : cluster [DBG] pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:24.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:23 smithi089 bash[19831]: cluster 2024-09-21T05:29:22.682533+0000 mgr.y (mgr.25142) 211 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:24.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:23 smithi089 bash[26514]: cluster 2024-09-21T05:29:22.682533+0000 mgr.y (mgr.25142) 211 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:23 smithi110 bash[22020]: cluster 2024-09-21T05:29:22.682533+0000 mgr.y (mgr.25142) 211 : cluster [DBG] pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:25.038464693Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:25 smithi089 bash[19831]: cluster 2024-09-21T05:29:24.683225+0000 mgr.y (mgr.25142) 212 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:26.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:25 smithi089 bash[26514]: cluster 2024-09-21T05:29:24.683225+0000 mgr.y (mgr.25142) 212 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:25 smithi110 bash[22020]: cluster 2024-09-21T05:29:24.683225+0000 mgr.y (mgr.25142) 212 : cluster [DBG] pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:26.393 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:26.490 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:26] "GET /metrics HTTP/1.1" 200 38238 "" "Prometheus/2.51.0" 2024-09-21T05:29:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:26 smithi110 bash[22020]: audit 2024-09-21T05:29:26.636743+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:26 smithi110 bash[22020]: audit 2024-09-21T05:29:26.638085+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:26 smithi110 bash[22020]: audit 2024-09-21T05:29:26.644950+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:27.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[26514]: audit 2024-09-21T05:29:26.636743+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:27.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[26514]: audit 2024-09-21T05:29:26.638085+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:27.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[26514]: audit 2024-09-21T05:29:26.644950+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:27.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[19831]: audit 2024-09-21T05:29:26.636743+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:27.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[19831]: audit 2024-09-21T05:29:26.638085+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:27.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:26 smithi089 bash[19831]: audit 2024-09-21T05:29:26.644950+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:29:27.959 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:29:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:28.053371706Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:28.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:29:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:28 smithi089 bash[19831]: cluster 2024-09-21T05:29:26.684774+0000 mgr.y (mgr.25142) 213 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:28 smithi089 bash[26514]: cluster 2024-09-21T05:29:26.684774+0000 mgr.y (mgr.25142) 213 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:28 smithi110 bash[22020]: cluster 2024-09-21T05:29:26.684774+0000 mgr.y (mgr.25142) 213 : cluster [DBG] pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:29 smithi089 bash[19831]: audit 2024-09-21T05:29:27.958514+0000 mgr.y (mgr.25142) 214 : audit [DBG] from='client.25520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:29 smithi089 bash[19831]: audit 2024-09-21T05:29:28.170154+0000 mgr.y (mgr.25142) 215 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:29 smithi089 bash[26514]: audit 2024-09-21T05:29:27.958514+0000 mgr.y (mgr.25142) 214 : audit [DBG] from='client.25520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:29 smithi089 bash[26514]: audit 2024-09-21T05:29:28.170154+0000 mgr.y (mgr.25142) 215 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:29 smithi110 bash[22020]: audit 2024-09-21T05:29:27.958514+0000 mgr.y (mgr.25142) 214 : audit [DBG] from='client.25520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:29 smithi110 bash[22020]: audit 2024-09-21T05:29:28.170154+0000 mgr.y (mgr.25142) 215 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:30 smithi089 bash[19831]: cluster 2024-09-21T05:29:28.685488+0000 mgr.y (mgr.25142) 216 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:30 smithi089 bash[26514]: cluster 2024-09-21T05:29:28.685488+0000 mgr.y (mgr.25142) 216 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:31.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:30 smithi110 bash[22020]: cluster 2024-09-21T05:29:28.685488+0000 mgr.y (mgr.25142) 216 : cluster [DBG] pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:31.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:31.060257822Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:31 smithi089 bash[19831]: cluster 2024-09-21T05:29:30.687174+0000 mgr.y (mgr.25142) 217 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:31 smithi089 bash[26514]: cluster 2024-09-21T05:29:30.687174+0000 mgr.y (mgr.25142) 217 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:31 smithi110 bash[22020]: cluster 2024-09-21T05:29:30.687174+0000 mgr.y (mgr.25142) 217 : cluster [DBG] pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:33.526 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:34.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:33 smithi110 bash[22020]: cluster 2024-09-21T05:29:32.688014+0000 mgr.y (mgr.25142) 218 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:34.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:33 smithi089 bash[19831]: cluster 2024-09-21T05:29:32.688014+0000 mgr.y (mgr.25142) 218 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:33 smithi089 bash[26514]: cluster 2024-09-21T05:29:32.688014+0000 mgr.y (mgr.25142) 218 : cluster [DBG] pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:34.045777134Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:35.173 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:29:35.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '"'"'{print $2}'"'"')' 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[19831]: cluster 2024-09-21T05:29:34.688844+0000 mgr.y (mgr.25142) 219 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[19831]: audit 2024-09-21T05:29:35.173002+0000 mon.c (mon.2) 237 : audit [DBG] from='client.? 172.21.15.89:0/2710776002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[19831]: audit 2024-09-21T05:29:35.453095+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[26514]: cluster 2024-09-21T05:29:34.688844+0000 mgr.y (mgr.25142) 219 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[26514]: audit 2024-09-21T05:29:35.173002+0000 mon.c (mon.2) 237 : audit [DBG] from='client.? 172.21.15.89:0/2710776002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:29:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:35 smithi089 bash[26514]: audit 2024-09-21T05:29:35.453095+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:35 smithi110 bash[22020]: cluster 2024-09-21T05:29:34.688844+0000 mgr.y (mgr.25142) 219 : cluster [DBG] pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:35 smithi110 bash[22020]: audit 2024-09-21T05:29:35.173002+0000 mon.c (mon.2) 237 : audit [DBG] from='client.? 172.21.15.89:0/2710776002' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:29:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:35 smithi110 bash[22020]: audit 2024-09-21T05:29:35.453095+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:36.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:36] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.51.0" 2024-09-21T05:29:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:37.051272094Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:38.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:37 smithi089 bash[19831]: cluster 2024-09-21T05:29:36.690534+0000 mgr.y (mgr.25142) 220 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:37 smithi089 bash[26514]: cluster 2024-09-21T05:29:36.690534+0000 mgr.y (mgr.25142) 220 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:37 smithi110 bash[22020]: cluster 2024-09-21T05:29:36.690534+0000 mgr.y (mgr.25142) 220 : cluster [DBG] pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:38 smithi089 bash[19831]: audit 2024-09-21T05:29:38.181264+0000 mgr.y (mgr.25142) 221 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:38 smithi089 bash[26514]: audit 2024-09-21T05:29:38.181264+0000 mgr.y (mgr.25142) 221 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:38 smithi110 bash[22020]: audit 2024-09-21T05:29:38.181264+0000 mgr.y (mgr.25142) 221 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:39 smithi089 bash[19831]: cluster 2024-09-21T05:29:38.691137+0000 mgr.y (mgr.25142) 222 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:39 smithi089 bash[26514]: cluster 2024-09-21T05:29:38.691137+0000 mgr.y (mgr.25142) 222 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:40.051 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:39 smithi110 bash[22020]: cluster 2024-09-21T05:29:38.691137+0000 mgr.y (mgr.25142) 222 : cluster [DBG] pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:40.052588076Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:40.686 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:42.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:41 smithi089 bash[19831]: cluster 2024-09-21T05:29:40.692503+0000 mgr.y (mgr.25142) 223 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:42.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:41 smithi089 bash[26514]: cluster 2024-09-21T05:29:40.692503+0000 mgr.y (mgr.25142) 223 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:41 smithi110 bash[22020]: cluster 2024-09-21T05:29:40.692503+0000 mgr.y (mgr.25142) 223 : cluster [DBG] pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:43.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:42 smithi110 bash[22020]: audit 2024-09-21T05:29:42.201291+0000 mgr.y (mgr.25142) 224 : audit [DBG] from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:42 smithi110 bash[22020]: audit 2024-09-21T05:29:42.549214+0000 mgr.y (mgr.25142) 225 : audit [DBG] from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:42 smithi089 bash[19831]: audit 2024-09-21T05:29:42.201291+0000 mgr.y (mgr.25142) 224 : audit [DBG] from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:42 smithi089 bash[19831]: audit 2024-09-21T05:29:42.549214+0000 mgr.y (mgr.25142) 225 : audit [DBG] from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:42 smithi089 bash[26514]: audit 2024-09-21T05:29:42.201291+0000 mgr.y (mgr.25142) 224 : audit [DBG] from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:42 smithi089 bash[26514]: audit 2024-09-21T05:29:42.549214+0000 mgr.y (mgr.25142) 225 : audit [DBG] from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:43.038051449Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:43 smithi089 bash[19831]: cluster 2024-09-21T05:29:42.693163+0000 mgr.y (mgr.25142) 226 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:43 smithi089 bash[26514]: cluster 2024-09-21T05:29:42.693163+0000 mgr.y (mgr.25142) 226 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:43 smithi110 bash[22020]: cluster 2024-09-21T05:29:42.693163+0000 mgr.y (mgr.25142) 226 : cluster [DBG] pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:44.960 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:45.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:29:46.195 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: cluster 2024-09-21T05:29:44.693872+0000 mgr.y (mgr.25142) 227 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: cephadm 2024-09-21T05:29:44.949291+0000 mgr.y (mgr.25142) 228 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: audit 2024-09-21T05:29:44.959423+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: audit 2024-09-21T05:29:44.961578+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: audit 2024-09-21T05:29:44.962789+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: audit 2024-09-21T05:29:44.971510+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[19831]: cephadm 2024-09-21T05:29:45.040364+0000 mgr.y (mgr.25142) 229 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: cluster 2024-09-21T05:29:44.693872+0000 mgr.y (mgr.25142) 227 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: cephadm 2024-09-21T05:29:44.949291+0000 mgr.y (mgr.25142) 228 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: audit 2024-09-21T05:29:44.959423+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: audit 2024-09-21T05:29:44.961578+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:46.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: audit 2024-09-21T05:29:44.962789+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:46.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: audit 2024-09-21T05:29:44.971510+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:45 smithi089 bash[26514]: cephadm 2024-09-21T05:29:45.040364+0000 mgr.y (mgr.25142) 229 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:46.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:46] "GET /metrics HTTP/1.1" 200 38239 "" "Prometheus/2.51.0" 2024-09-21T05:29:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:46.035022245Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: cluster 2024-09-21T05:29:44.693872+0000 mgr.y (mgr.25142) 227 : cluster [DBG] pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: cephadm 2024-09-21T05:29:44.949291+0000 mgr.y (mgr.25142) 228 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: audit 2024-09-21T05:29:44.959423+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: audit 2024-09-21T05:29:44.961578+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: audit 2024-09-21T05:29:44.962789+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: audit 2024-09-21T05:29:44.971510+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:45 smithi110 bash[22020]: cephadm 2024-09-21T05:29:45.040364+0000 mgr.y (mgr.25142) 229 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:29:48.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: cluster 2024-09-21T05:29:46.695463+0000 mgr.y (mgr.25142) 230 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:48.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.683945+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.687932+0000 mon.a (mon.0) 1518 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:48.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.691189+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:48.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.697642+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.701186+0000 mon.a (mon.0) 1521 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[19831]: audit 2024-09-21T05:29:47.702652+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: cluster 2024-09-21T05:29:46.695463+0000 mgr.y (mgr.25142) 230 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.683945+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.687932+0000 mon.a (mon.0) 1518 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.691189+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.697642+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.701186+0000 mon.a (mon.0) 1521 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:29:48.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:48 smithi089 bash[26514]: audit 2024-09-21T05:29:47.702652+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: cluster 2024-09-21T05:29:46.695463+0000 mgr.y (mgr.25142) 230 : cluster [DBG] pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.683945+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.687932+0000 mon.a (mon.0) 1518 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.691189+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.697642+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.701186+0000 mon.a (mon.0) 1521 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:29:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:48 smithi110 bash[22020]: audit 2024-09-21T05:29:47.702652+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-09-21T05:29:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:49.049405569Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[22020]: cephadm 2024-09-21T05:29:47.684766+0000 mgr.y (mgr.25142) 231 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:29:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[22020]: cephadm 2024-09-21T05:29:47.684903+0000 mgr.y (mgr.25142) 232 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:29:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[22020]: cephadm 2024-09-21T05:29:47.692399+0000 mgr.y (mgr.25142) 233 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:29:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[22020]: cephadm 2024-09-21T05:29:47.703663+0000 mgr.y (mgr.25142) 234 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-09-21T05:29:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:49 smithi110 bash[22020]: audit 2024-09-21T05:29:48.186217+0000 mgr.y (mgr.25142) 235 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[19831]: cephadm 2024-09-21T05:29:47.684766+0000 mgr.y (mgr.25142) 231 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:29:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[19831]: cephadm 2024-09-21T05:29:47.684903+0000 mgr.y (mgr.25142) 232 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:29:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[19831]: cephadm 2024-09-21T05:29:47.692399+0000 mgr.y (mgr.25142) 233 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:29:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[19831]: cephadm 2024-09-21T05:29:47.703663+0000 mgr.y (mgr.25142) 234 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-09-21T05:29:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[19831]: audit 2024-09-21T05:29:48.186217+0000 mgr.y (mgr.25142) 235 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:49.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[26514]: cephadm 2024-09-21T05:29:47.684766+0000 mgr.y (mgr.25142) 231 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:29:49.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[26514]: cephadm 2024-09-21T05:29:47.684903+0000 mgr.y (mgr.25142) 232 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:29:49.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[26514]: cephadm 2024-09-21T05:29:47.692399+0000 mgr.y (mgr.25142) 233 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:29:49.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[26514]: cephadm 2024-09-21T05:29:47.703663+0000 mgr.y (mgr.25142) 234 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-09-21T05:29:49.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:49 smithi089 bash[26514]: audit 2024-09-21T05:29:48.186217+0000 mgr.y (mgr.25142) 235 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:50.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[19831]: cluster 2024-09-21T05:29:48.696095+0000 mgr.y (mgr.25142) 236 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:50.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[19831]: audit 2024-09-21T05:29:50.130028+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:50.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[19831]: audit 2024-09-21T05:29:50.134643+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:29:50.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[19831]: audit 2024-09-21T05:29:50.136114+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:29:50.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[19831]: audit 2024-09-21T05:29:50.137787+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:50.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[26514]: cluster 2024-09-21T05:29:48.696095+0000 mgr.y (mgr.25142) 236 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:50.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[26514]: audit 2024-09-21T05:29:50.130028+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:50.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[26514]: audit 2024-09-21T05:29:50.134643+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:29:50.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[26514]: audit 2024-09-21T05:29:50.136114+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:29:50.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:50 smithi089 bash[26514]: audit 2024-09-21T05:29:50.137787+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:50 smithi110 bash[22020]: cluster 2024-09-21T05:29:48.696095+0000 mgr.y (mgr.25142) 236 : cluster [DBG] pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:50 smithi110 bash[22020]: audit 2024-09-21T05:29:50.130028+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:50 smithi110 bash[22020]: audit 2024-09-21T05:29:50.134643+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:50 smithi110 bash[22020]: audit 2024-09-21T05:29:50.136114+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:29:50.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:50 smithi110 bash[22020]: audit 2024-09-21T05:29:50.137787+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:29:51.209 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[19831]: cephadm 2024-09-21T05:29:50.122149+0000 mgr.y (mgr.25142) 237 : cephadm [INF] Upgrade: Updating mon.b 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[19831]: cephadm 2024-09-21T05:29:50.139770+0000 mgr.y (mgr.25142) 238 : cephadm [INF] Deploying daemon mon.b on smithi110 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[19831]: audit 2024-09-21T05:29:50.453667+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[26514]: cephadm 2024-09-21T05:29:50.122149+0000 mgr.y (mgr.25142) 237 : cephadm [INF] Upgrade: Updating mon.b 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[26514]: cephadm 2024-09-21T05:29:50.139770+0000 mgr.y (mgr.25142) 238 : cephadm [INF] Deploying daemon mon.b on smithi110 2024-09-21T05:29:51.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:51 smithi089 bash[26514]: audit 2024-09-21T05:29:50.453667+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:51.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:51 smithi110 bash[22020]: cephadm 2024-09-21T05:29:50.122149+0000 mgr.y (mgr.25142) 237 : cephadm [INF] Upgrade: Updating mon.b 2024-09-21T05:29:51.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:51 smithi110 bash[22020]: cephadm 2024-09-21T05:29:50.139770+0000 mgr.y (mgr.25142) 238 : cephadm [INF] Deploying daemon mon.b on smithi110 2024-09-21T05:29:51.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:51 smithi110 bash[22020]: audit 2024-09-21T05:29:50.453667+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:29:52.278 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:52.064287985Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:52.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:52 smithi089 bash[19831]: cluster 2024-09-21T05:29:50.697377+0000 mgr.y (mgr.25142) 239 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:52.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:52 smithi089 bash[26514]: cluster 2024-09-21T05:29:50.697377+0000 mgr.y (mgr.25142) 239 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:52.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:52 smithi110 bash[22020]: cluster 2024-09-21T05:29:50.697377+0000 mgr.y (mgr.25142) 239 : cluster [DBG] pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:52.709 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:29:52.935 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.935 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.936 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.936 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.936 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.937 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.937 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.937 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: Stopping Ceph mon.b for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:29:52.937 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:52 smithi110 bash[22020]: debug 2024-09-21T05:29:52.829+0000 7efc6e74a640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:29:52.937 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:52 smithi110 bash[22020]: debug 2024-09-21T05:29:52.829+0000 7efc6e74a640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:29:52.937 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:52.938 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:29:52 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:53.355 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:29:53.355 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (2m) 2m ago 29m 14.0M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (104s) 98s ago 29m 32.1M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (4m) 2m ago 26m 47.7M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (3m) 98s ago 37m 440M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (14m) 2m ago 40m 503M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (40m) 2m ago 40m 87.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (38m) 98s ago 38m 60.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 145a2ea331e2 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (38m) 2m ago 38m 62.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (3m) 2m ago 29m 7843k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (3m) 98s ago 29m 7860k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (36m) 2m ago 37m 58.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (36m) 2m ago 36m 68.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (35m) 2m ago 35m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (34m) 2m ago 34m 59.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:29:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (33m) 98s ago 33m 74.0M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (32m) 98s ago 32m 56.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (31m) 98s ago 31m 64.5M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (30m) 98s ago 30m 65.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (2m) 98s ago 29m 35.3M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (27m) 2m ago 27m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:29:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (27m) 98s ago 27m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:29:53.725 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:29:53.726 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:29:53.772 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 bash[70718]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-b 2024-09-21T05:29:53.773 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 bash[70779]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-b 2024-09-21T05:29:53.773 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T05:29:53.773 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: Stopped Ceph mon.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:29:54.037 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:29:54.037 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:29:54.037 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:29:54.037 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi110", 2024-09-21T05:29:54.037 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:29:54.038 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/1 daemons upgraded", 2024-09-21T05:29:54.038 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T05:29:54.038 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:29:54.038 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:29:54.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.054 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.054 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.055 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: Started Ceph mon.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:29:54.055 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.056 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:54.056 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:29:53 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:29:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:55.018060116Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.053+0000 7f7bfdf3bc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.053+0000 7f7bfdf3bc80 0 ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev), process ceph-mon, pid 7 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.053+0000 7f7bfdf3bc80 0 pidfile_write: ignore empty --pid-file 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 0 load: jerasure load: lrc 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Git sha 0 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Compile date 2024-09-20 23:32:13 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: DB SUMMARY 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: DB Session ID: LYMIDCZIBVHJ3WB7LJMG 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: CURRENT file: CURRENT 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 4325 Bytes 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000063.sst 2024-09-21T05:29:55.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000061.log size: 1070616 ; 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.create_if_missing: 0 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.env: 0x55af55c31120 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.info_log: 0x55af57379700 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.statistics: (nil) 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.use_fsync: 0 2024-09-21T05:29:55.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:29:55.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.db_log_dir: 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.wal_dir: 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.write_buffer_manager: 0x55af5737c1e0 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:29:55.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.unordered_write: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.row_cache: None 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.wal_filter: None 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:29:55.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.wal_compression: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:29:55.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_open_files: -1 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:29:55.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T05:29:55.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Compression algorithms supported: 2024-09-21T05:29:55.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kZSTD supported: 0 2024-09-21T05:29:55.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T05:29:55.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T05:29:55.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:29:55.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T05:29:55.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T05:29:55.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:29:55.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T05:29:55.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:29:55.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:29:55.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.merge_operator: 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_filter: None 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af57379320) 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: cache_index_and_filter_blocks: 1 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: pin_top_level_index_and_filter: 1 2024-09-21T05:29:55.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: index_type: 0 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: data_block_index_type: 0 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: index_shortening: 1 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: checksum: 4 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: no_block_cache: 0 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_cache: 0x55af5736f610 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_cache_name: BinnedLRUCache 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_cache_options: 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: capacity : 536870912 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: num_shard_bits : 4 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: strict_capacity_limit : 0 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: high_pri_pool_ratio: 0.000 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_cache_compressed: (nil) 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: persistent_cache: (nil) 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_size: 4096 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_size_deviation: 10 2024-09-21T05:29:55.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_restart_interval: 16 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: index_block_restart_interval: 1 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: metadata_block_size: 4096 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: partition_filters: 0 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: use_delta_encoding: 1 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: filter_policy: bloomfilter 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: whole_key_filtering: 1 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: verify_compression: 0 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: read_amp_bytes_per_bit: 0 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: format_version: 5 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: enable_index_compression: 1 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: block_align: 0 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: max_auto_readahead_size: 262144 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: prepopulate_block_cache: 0 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: initial_auto_readahead_size: 8192 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: num_file_reads_for_auto_readahead: 2 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:29:55.317 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression: NoCompression 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.num_levels: 7 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:29:55.318 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:29:55.319 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:29:55.320 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:29:55.321 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.ttl: 2592000 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:29:55.322 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 65, last_sequence is 33488, log_number is 61,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 61 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 61 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4a1eb6fb-3b69-44fc-a645-2974e717c17d 2024-09-21T05:29:55.323 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896595062856, "job": 1, "event": "recovery_started", "wal_files": [61]} 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.057+0000 7f7bfdf3bc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #61 mode 2 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896595067611, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 66, "file_size": 703362, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 33493, "largest_seqno": 34186, "table_properties": {"data_size": 699950, "index_size": 1668, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 5778, "raw_average_key_size": 22, "raw_value_size": 694405, "raw_average_value_size": 2681, "num_data_blocks": 75, "num_entries": 259, "num_filter_entries": 259, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726896595, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4a1eb6fb-3b69-44fc-a645-2974e717c17d", "db_session_id": "LYMIDCZIBVHJ3WB7LJMG", "orig_file_number": 66, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896595067745, "job": 1, "event": "recovery_finished"} 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 68 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000061.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af5739ce00 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 4 rocksdb: DB pointer 0x55af574a0000 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bf3d03640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bf3d03640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: ** DB Stats ** 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:29:55.324 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: ** Compaction Stats [default] ** 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: L0 1/0 686.88 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 269.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: L6 1/0 10.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Sum 2/0 10.82 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 269.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 269.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: ** Compaction Stats [default] ** 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:29:55.325 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 269.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Flush(GB): cumulative 0.001, interval 0.001 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Cumulative compaction: 0.00 GB write, 87.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Interval compaction: 0.00 GB write, 87.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Block cache BinnedLRUCache@0x55af5736f610#7 capacity: 512.00 MB usage: 2.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:29:55.326 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 0 starting mon.b rank 1 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.065+0000 7f7bfdf3bc80 1 mon.b@-1(???) e3 preinit fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).mds e1 new map 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).mds e1 print_map 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: e1 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: btime 2024-09-21T04:49:45:405505+0000 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: legacy client fscid: -1 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: No filesystems configured 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 0 mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:29:55.327 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:55 smithi110 bash[70834]: debug 2024-09-21T05:29:55.069+0000 7f7bfdf3bc80 1 mon.b@-1(???).paxosservice(auth 1..29) refresh upgraded, format 0 -> 3 2024-09-21T05:29:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:29:56] "GET /metrics HTTP/1.1" 200 38235 "" "Prometheus/2.51.0" 2024-09-21T05:29:56.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: audit 2024-09-21T05:29:53.724714+0000 mon.c (mon.2) 238 : audit [DBG] from='client.? 172.21.15.89:0/3091595235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:56.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: audit 2024-09-21T05:29:54.036832+0000 mgr.y (mgr.25142) 244 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:54.698340+0000 mgr.y (mgr.25142) 245 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.081520+0000 mon.a (mon.0) 1528 : cluster [INF] mon.a calling monitor election 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.081555+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.111386+0000 mon.a (mon.0) 1529 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127228+0000 mon.a (mon.0) 1530 : cluster [DBG] monmap epoch 3 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127291+0000 mon.a (mon.0) 1531 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127323+0000 mon.a (mon.0) 1532 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127357+0000 mon.a (mon.0) 1533 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127391+0000 mon.a (mon.0) 1534 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127426+0000 mon.a (mon.0) 1535 : cluster [DBG] election_strategy: 1 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127456+0000 mon.a (mon.0) 1536 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127486+0000 mon.a (mon.0) 1537 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.127526+0000 mon.a (mon.0) 1538 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:29:56.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.150513+0000 mon.a (mon.0) 1539 : cluster [DBG] fsmap 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.150569+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.151398+0000 mon.a (mon.0) 1541 : cluster [DBG] mgrmap e42: y(active, since 4m), standbys: x 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: cluster 2024-09-21T05:29:55.151676+0000 mon.a (mon.0) 1542 : cluster [INF] overall HEALTH_OK 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: audit 2024-09-21T05:29:55.161088+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[19831]: audit 2024-09-21T05:29:55.173559+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: audit 2024-09-21T05:29:53.724714+0000 mon.c (mon.2) 238 : audit [DBG] from='client.? 172.21.15.89:0/3091595235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: audit 2024-09-21T05:29:54.036832+0000 mgr.y (mgr.25142) 244 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:54.698340+0000 mgr.y (mgr.25142) 245 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.081520+0000 mon.a (mon.0) 1528 : cluster [INF] mon.a calling monitor election 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.081555+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.111386+0000 mon.a (mon.0) 1529 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:29:56.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127228+0000 mon.a (mon.0) 1530 : cluster [DBG] monmap epoch 3 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127291+0000 mon.a (mon.0) 1531 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127323+0000 mon.a (mon.0) 1532 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127357+0000 mon.a (mon.0) 1533 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127391+0000 mon.a (mon.0) 1534 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127426+0000 mon.a (mon.0) 1535 : cluster [DBG] election_strategy: 1 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127456+0000 mon.a (mon.0) 1536 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127486+0000 mon.a (mon.0) 1537 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.127526+0000 mon.a (mon.0) 1538 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.150513+0000 mon.a (mon.0) 1539 : cluster [DBG] fsmap 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.150569+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.151398+0000 mon.a (mon.0) 1541 : cluster [DBG] mgrmap e42: y(active, since 4m), standbys: x 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: cluster 2024-09-21T05:29:55.151676+0000 mon.a (mon.0) 1542 : cluster [INF] overall HEALTH_OK 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: audit 2024-09-21T05:29:55.161088+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.550 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:56 smithi089 bash[26514]: audit 2024-09-21T05:29:55.173559+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:53.724714+0000 mon.c (mon.2) 238 : audit [DBG] from='client.? 172.21.15.89:0/3091595235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:56.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:53.724714+0000 mon.c (mon.2) 238 : audit [DBG] from='client.? 172.21.15.89:0/3091595235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:54.036832+0000 mgr.y (mgr.25142) 244 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:54.036832+0000 mgr.y (mgr.25142) 244 : audit [DBG] from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:54.698340+0000 mgr.y (mgr.25142) 245 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:54.698340+0000 mgr.y (mgr.25142) 245 : cluster [DBG] pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.081520+0000 mon.a (mon.0) 1528 : cluster [INF] mon.a calling monitor election 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.081520+0000 mon.a (mon.0) 1528 : cluster [INF] mon.a calling monitor election 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.081555+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.081555+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.111386+0000 mon.a (mon.0) 1529 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.111386+0000 mon.a (mon.0) 1529 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127228+0000 mon.a (mon.0) 1530 : cluster [DBG] monmap epoch 3 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127228+0000 mon.a (mon.0) 1530 : cluster [DBG] monmap epoch 3 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127291+0000 mon.a (mon.0) 1531 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:56.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127291+0000 mon.a (mon.0) 1531 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127323+0000 mon.a (mon.0) 1532 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127323+0000 mon.a (mon.0) 1532 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127357+0000 mon.a (mon.0) 1533 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127357+0000 mon.a (mon.0) 1533 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127391+0000 mon.a (mon.0) 1534 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127391+0000 mon.a (mon.0) 1534 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127426+0000 mon.a (mon.0) 1535 : cluster [DBG] election_strategy: 1 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127426+0000 mon.a (mon.0) 1535 : cluster [DBG] election_strategy: 1 2024-09-21T05:29:56.556 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127456+0000 mon.a (mon.0) 1536 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127456+0000 mon.a (mon.0) 1536 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127486+0000 mon.a (mon.0) 1537 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127486+0000 mon.a (mon.0) 1537 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127526+0000 mon.a (mon.0) 1538 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.127526+0000 mon.a (mon.0) 1538 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.150513+0000 mon.a (mon.0) 1539 : cluster [DBG] fsmap 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.150513+0000 mon.a (mon.0) 1539 : cluster [DBG] fsmap 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.150569+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.150569+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.151398+0000 mon.a (mon.0) 1541 : cluster [DBG] mgrmap e42: y(active, since 4m), standbys: x 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.151398+0000 mon.a (mon.0) 1541 : cluster [DBG] mgrmap e42: y(active, since 4m), standbys: x 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.151676+0000 mon.a (mon.0) 1542 : cluster [INF] overall HEALTH_OK 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: cluster 2024-09-21T05:29:55.151676+0000 mon.a (mon.0) 1542 : cluster [INF] overall HEALTH_OK 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:55.161088+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.557 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:55.161088+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:55.173559+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:56.558 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:56 smithi110 bash[70834]: audit 2024-09-21T05:29:55.173559+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:29:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:29:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:29:58.047113046Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:29:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:58 smithi110 bash[70834]: cluster 2024-09-21T05:29:56.700097+0000 mgr.y (mgr.25142) 246 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:58 smithi110 bash[70834]: cluster 2024-09-21T05:29:56.700097+0000 mgr.y (mgr.25142) 246 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:58.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:58 smithi089 bash[19831]: cluster 2024-09-21T05:29:56.700097+0000 mgr.y (mgr.25142) 246 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:58.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:58 smithi089 bash[26514]: cluster 2024-09-21T05:29:56.700097+0000 mgr.y (mgr.25142) 246 : cluster [DBG] pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:29:59.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:29:59 smithi089 bash[19831]: audit 2024-09-21T05:29:58.187963+0000 mgr.y (mgr.25142) 247 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:59.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:29:59 smithi089 bash[26514]: audit 2024-09-21T05:29:58.187963+0000 mgr.y (mgr.25142) 247 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:59.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:59 smithi110 bash[70834]: audit 2024-09-21T05:29:58.187963+0000 mgr.y (mgr.25142) 247 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:29:59.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:29:59 smithi110 bash[70834]: audit 2024-09-21T05:29:58.187963+0000 mgr.y (mgr.25142) 247 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:00.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:00 smithi089 bash[68019]: debug 2024-09-21T05:30:00.078+0000 7f1a88244640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T05:30:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:00 smithi089 bash[19831]: cluster 2024-09-21T05:29:58.700918+0000 mgr.y (mgr.25142) 248 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:00 smithi089 bash[19831]: cluster 2024-09-21T05:30:00.000153+0000 mon.a (mon.0) 1545 : cluster [INF] overall HEALTH_OK 2024-09-21T05:30:00.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:00 smithi089 bash[26514]: cluster 2024-09-21T05:29:58.700918+0000 mgr.y (mgr.25142) 248 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:00.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:00 smithi089 bash[26514]: cluster 2024-09-21T05:30:00.000153+0000 mon.a (mon.0) 1545 : cluster [INF] overall HEALTH_OK 2024-09-21T05:30:00.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:00 smithi110 bash[70834]: cluster 2024-09-21T05:29:58.700918+0000 mgr.y (mgr.25142) 248 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:00.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:00 smithi110 bash[70834]: cluster 2024-09-21T05:29:58.700918+0000 mgr.y (mgr.25142) 248 : cluster [DBG] pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:00.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:00 smithi110 bash[70834]: cluster 2024-09-21T05:30:00.000153+0000 mon.a (mon.0) 1545 : cluster [INF] overall HEALTH_OK 2024-09-21T05:30:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:00 smithi110 bash[70834]: cluster 2024-09-21T05:30:00.000153+0000 mon.a (mon.0) 1545 : cluster [INF] overall HEALTH_OK 2024-09-21T05:30:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:01.035313887Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[19831]: cluster 2024-09-21T05:30:00.702562+0000 mgr.y (mgr.25142) 249 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[19831]: audit 2024-09-21T05:30:01.146454+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[19831]: audit 2024-09-21T05:30:01.156960+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[26514]: cluster 2024-09-21T05:30:00.702562+0000 mgr.y (mgr.25142) 249 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[26514]: audit 2024-09-21T05:30:01.146454+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:02 smithi089 bash[26514]: audit 2024-09-21T05:30:01.156960+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: cluster 2024-09-21T05:30:00.702562+0000 mgr.y (mgr.25142) 249 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: cluster 2024-09-21T05:30:00.702562+0000 mgr.y (mgr.25142) 249 : cluster [DBG] pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: audit 2024-09-21T05:30:01.146454+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: audit 2024-09-21T05:30:01.146454+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: audit 2024-09-21T05:30:01.156960+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:02 smithi110 bash[70834]: audit 2024-09-21T05:30:01.156960+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:03 smithi089 bash[19831]: audit 2024-09-21T05:30:02.309647+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:03 smithi089 bash[19831]: audit 2024-09-21T05:30:02.320304+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:03 smithi089 bash[26514]: audit 2024-09-21T05:30:02.309647+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:03 smithi089 bash[26514]: audit 2024-09-21T05:30:02.320304+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:03 smithi110 bash[70834]: audit 2024-09-21T05:30:02.309647+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:03 smithi110 bash[70834]: audit 2024-09-21T05:30:02.309647+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:03 smithi110 bash[70834]: audit 2024-09-21T05:30:02.320304+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:03 smithi110 bash[70834]: audit 2024-09-21T05:30:02.320304+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:04.029518071Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:04.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:04 smithi089 bash[19831]: cluster 2024-09-21T05:30:02.703460+0000 mgr.y (mgr.25142) 250 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:04.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:04 smithi089 bash[26514]: cluster 2024-09-21T05:30:02.703460+0000 mgr.y (mgr.25142) 250 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:04 smithi110 bash[70834]: cluster 2024-09-21T05:30:02.703460+0000 mgr.y (mgr.25142) 250 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:04 smithi110 bash[70834]: cluster 2024-09-21T05:30:02.703460+0000 mgr.y (mgr.25142) 250 : cluster [DBG] pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:06.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:06] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.51.0" 2024-09-21T05:30:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:06 smithi089 bash[19831]: cluster 2024-09-21T05:30:04.704305+0000 mgr.y (mgr.25142) 251 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:06 smithi089 bash[19831]: audit 2024-09-21T05:30:05.453932+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:06 smithi089 bash[26514]: cluster 2024-09-21T05:30:04.704305+0000 mgr.y (mgr.25142) 251 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:06 smithi089 bash[26514]: audit 2024-09-21T05:30:05.453932+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:06 smithi110 bash[70834]: cluster 2024-09-21T05:30:04.704305+0000 mgr.y (mgr.25142) 251 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:06 smithi110 bash[70834]: cluster 2024-09-21T05:30:04.704305+0000 mgr.y (mgr.25142) 251 : cluster [DBG] pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:06 smithi110 bash[70834]: audit 2024-09-21T05:30:05.453932+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:06 smithi110 bash[70834]: audit 2024-09-21T05:30:05.453932+0000 mon.a (mon.0) 1550 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:07.05080476Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:08.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:08 smithi089 bash[19831]: cluster 2024-09-21T05:30:06.706041+0000 mgr.y (mgr.25142) 252 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:08.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:08 smithi089 bash[26514]: cluster 2024-09-21T05:30:06.706041+0000 mgr.y (mgr.25142) 252 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:08.610 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:08 smithi110 bash[70834]: cluster 2024-09-21T05:30:06.706041+0000 mgr.y (mgr.25142) 252 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:08.610 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:08 smithi110 bash[70834]: cluster 2024-09-21T05:30:06.706041+0000 mgr.y (mgr.25142) 252 : cluster [DBG] pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:09 smithi089 bash[19831]: audit 2024-09-21T05:30:08.198183+0000 mgr.y (mgr.25142) 253 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:09 smithi089 bash[26514]: audit 2024-09-21T05:30:08.198183+0000 mgr.y (mgr.25142) 253 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:09 smithi110 bash[70834]: audit 2024-09-21T05:30:08.198183+0000 mgr.y (mgr.25142) 253 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:09 smithi110 bash[70834]: audit 2024-09-21T05:30:08.198183+0000 mgr.y (mgr.25142) 253 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:10.022334591Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:10 smithi089 bash[19831]: cluster 2024-09-21T05:30:08.706767+0000 mgr.y (mgr.25142) 254 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:10 smithi089 bash[26514]: cluster 2024-09-21T05:30:08.706767+0000 mgr.y (mgr.25142) 254 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:10 smithi110 bash[70834]: cluster 2024-09-21T05:30:08.706767+0000 mgr.y (mgr.25142) 254 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:10 smithi110 bash[70834]: cluster 2024-09-21T05:30:08.706767+0000 mgr.y (mgr.25142) 254 : cluster [DBG] pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: cluster 2024-09-21T05:30:10.708325+0000 mgr.y (mgr.25142) 255 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: audit 2024-09-21T05:30:12.300746+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: audit 2024-09-21T05:30:12.311618+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: audit 2024-09-21T05:30:12.313926+0000 mon.a (mon.0) 1553 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: audit 2024-09-21T05:30:12.315694+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[26514]: audit 2024-09-21T05:30:12.326364+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: cluster 2024-09-21T05:30:10.708325+0000 mgr.y (mgr.25142) 255 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: audit 2024-09-21T05:30:12.300746+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: audit 2024-09-21T05:30:12.311618+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: audit 2024-09-21T05:30:12.313926+0000 mon.a (mon.0) 1553 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: audit 2024-09-21T05:30:12.315694+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:12.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:12 smithi089 bash[19831]: audit 2024-09-21T05:30:12.326364+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: cluster 2024-09-21T05:30:10.708325+0000 mgr.y (mgr.25142) 255 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: cluster 2024-09-21T05:30:10.708325+0000 mgr.y (mgr.25142) 255 : cluster [DBG] pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.300746+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.300746+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.311618+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.311618+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.313926+0000 mon.a (mon.0) 1553 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.313926+0000 mon.a (mon.0) 1553 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.315694+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.315694+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.326364+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:12.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:12 smithi110 bash[70834]: audit 2024-09-21T05:30:12.326364+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:13.042942911Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.459187+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.461910+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.464208+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.465134+0000 mgr.y (mgr.25142) 256 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.474080+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.479351+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.480342+0000 mgr.y (mgr.25142) 257 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.488756+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.493914+0000 mon.a (mon.0) 1562 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.495011+0000 mgr.y (mgr.25142) 258 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.503408+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.508033+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.509060+0000 mgr.y (mgr.25142) 259 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.517328+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.521475+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.529398+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.534648+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.536041+0000 mgr.y (mgr.25142) 260 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.544902+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.551914+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.553544+0000 mgr.y (mgr.25142) 261 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.459187+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.461910+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.464208+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.465134+0000 mgr.y (mgr.25142) 256 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.474080+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.479351+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.480342+0000 mgr.y (mgr.25142) 257 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.488756+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.493914+0000 mon.a (mon.0) 1562 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.495011+0000 mgr.y (mgr.25142) 258 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.503408+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.508033+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.509060+0000 mgr.y (mgr.25142) 259 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.517328+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.521475+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.529398+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.534648+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.536041+0000 mgr.y (mgr.25142) 260 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.544902+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.551914+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.553544+0000 mgr.y (mgr.25142) 261 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.562444+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.569437+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.571039+0000 mgr.y (mgr.25142) 262 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.579730+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.586270+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.587922+0000 mgr.y (mgr.25142) 263 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.590094+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.593216+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.594739+0000 mgr.y (mgr.25142) 264 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.596860+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.599995+0000 mon.a (mon.0) 1578 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.601592+0000 mgr.y (mgr.25142) 265 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.603885+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.607115+0000 mon.a (mon.0) 1580 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.608716+0000 mgr.y (mgr.25142) 266 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.610997+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.613816+0000 mon.a (mon.0) 1582 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.615431+0000 mgr.y (mgr.25142) 267 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.617516+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.620237+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.562444+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.569437+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.571039+0000 mgr.y (mgr.25142) 262 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.579730+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.586270+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.587922+0000 mgr.y (mgr.25142) 263 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.590094+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.593216+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.594739+0000 mgr.y (mgr.25142) 264 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.596860+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.599995+0000 mon.a (mon.0) 1578 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.601592+0000 mgr.y (mgr.25142) 265 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.603885+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.607115+0000 mon.a (mon.0) 1580 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.608716+0000 mgr.y (mgr.25142) 266 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.610997+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.613816+0000 mon.a (mon.0) 1582 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.615431+0000 mgr.y (mgr.25142) 267 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.617516+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.804 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.620237+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.621849+0000 mgr.y (mgr.25142) 268 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.623920+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.625134+0000 mgr.y (mgr.25142) 269 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.627013+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.635358+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.640145+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.648376+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.652860+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.660921+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.665341+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:30:13.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.666902+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.676068+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.680524+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.682096+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.690123+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.694347+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.695811+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.621849+0000 mgr.y (mgr.25142) 268 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.623920+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.625134+0000 mgr.y (mgr.25142) 269 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.627013+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:30:13.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.635358+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.640145+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.648376+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.652860+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.660921+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.665341+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.666902+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.676068+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.680524+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.682096+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.690123+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.694347+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.695811+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.703945+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.708289+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.710704+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.716923+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.721180+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.727352+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.731683+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.733201+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.734695+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.736186+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.737692+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.739225+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.741256+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.747376+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.749552+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.751512+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.762096+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.889798+0000 mon.a (mon.0) 1617 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.891128+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[26514]: audit 2024-09-21T05:30:12.899933+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.703945+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.708289+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:30:13.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.710704+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.716923+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.721180+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.727352+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.731683+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.733201+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.734695+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.736186+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.737692+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.739225+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.741256+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.747376+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.749552+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.751512+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.762096+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.889798+0000 mon.a (mon.0) 1617 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.891128+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:13 smithi089 bash[19831]: audit 2024-09-21T05:30:12.899933+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.459187+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.459187+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.461910+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.461910+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.464208+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.464208+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.465134+0000 mgr.y (mgr.25142) 256 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.465134+0000 mgr.y (mgr.25142) 256 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:30:13.812 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.474080+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.474080+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.479351+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.479351+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.480342+0000 mgr.y (mgr.25142) 257 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.480342+0000 mgr.y (mgr.25142) 257 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.488756+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.488756+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.493914+0000 mon.a (mon.0) 1562 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.493914+0000 mon.a (mon.0) 1562 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.495011+0000 mgr.y (mgr.25142) 258 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.495011+0000 mgr.y (mgr.25142) 258 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.503408+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.503408+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.813 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.508033+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.508033+0000 mon.a (mon.0) 1564 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.509060+0000 mgr.y (mgr.25142) 259 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.509060+0000 mgr.y (mgr.25142) 259 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.517328+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.517328+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.521475+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.521475+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.529398+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.529398+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.534648+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.534648+0000 mon.a (mon.0) 1568 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.536041+0000 mgr.y (mgr.25142) 260 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.536041+0000 mgr.y (mgr.25142) 260 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:30:13.814 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.544902+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.544902+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.551914+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.551914+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.553544+0000 mgr.y (mgr.25142) 261 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.553544+0000 mgr.y (mgr.25142) 261 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.562444+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.562444+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.569437+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.569437+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.571039+0000 mgr.y (mgr.25142) 262 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.571039+0000 mgr.y (mgr.25142) 262 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.579730+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.815 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.579730+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.586270+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.586270+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.587922+0000 mgr.y (mgr.25142) 263 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.587922+0000 mgr.y (mgr.25142) 263 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.590094+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.590094+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.593216+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.593216+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.594739+0000 mgr.y (mgr.25142) 264 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.594739+0000 mgr.y (mgr.25142) 264 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.596860+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.596860+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.816 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.599995+0000 mon.a (mon.0) 1578 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.599995+0000 mon.a (mon.0) 1578 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.601592+0000 mgr.y (mgr.25142) 265 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.601592+0000 mgr.y (mgr.25142) 265 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.603885+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.603885+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.607115+0000 mon.a (mon.0) 1580 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.607115+0000 mon.a (mon.0) 1580 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.608716+0000 mgr.y (mgr.25142) 266 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.608716+0000 mgr.y (mgr.25142) 266 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.610997+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.610997+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.613816+0000 mon.a (mon.0) 1582 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.817 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.613816+0000 mon.a (mon.0) 1582 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.615431+0000 mgr.y (mgr.25142) 267 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.615431+0000 mgr.y (mgr.25142) 267 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.617516+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.617516+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.620237+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.620237+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.621849+0000 mgr.y (mgr.25142) 268 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.621849+0000 mgr.y (mgr.25142) 268 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.623920+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.623920+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.625134+0000 mgr.y (mgr.25142) 269 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:30:13.818 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.625134+0000 mgr.y (mgr.25142) 269 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.627013+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.627013+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.635358+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.635358+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.640145+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.640145+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.648376+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.648376+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.652860+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.652860+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.660921+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.660921+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.665341+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:30:13.819 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.665341+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.666902+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.666902+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.676068+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.676068+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.680524+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.680524+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.682096+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.682096+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.690123+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.690123+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.694347+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.694347+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.695811+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:30:13.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.695811+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.703945+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.703945+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.708289+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.708289+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.710704+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.710704+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.716923+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.716923+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.721180+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.721180+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.727352+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.727352+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:30:13.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.731683+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.731683+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.733201+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.733201+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.734695+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.734695+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.736186+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.736186+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.737692+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.737692+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.739225+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.739225+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.741256+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.741256+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T05:30:13.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.747376+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.747376+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.749552+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.749552+0000 mon.a (mon.0) 1614 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.751512+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.751512+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.762096+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.762096+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.889798+0000 mon.a (mon.0) 1617 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.889798+0000 mon.a (mon.0) 1617 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.891128+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.891128+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.899933+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:13.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:13 smithi110 bash[70834]: audit 2024-09-21T05:30:12.899933+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:14.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:14 smithi089 bash[19831]: cluster 2024-09-21T05:30:12.709091+0000 mgr.y (mgr.25142) 270 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:14.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:14 smithi089 bash[19831]: cephadm 2024-09-21T05:30:12.740383+0000 mgr.y (mgr.25142) 271 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:30:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:14 smithi089 bash[26514]: cluster 2024-09-21T05:30:12.709091+0000 mgr.y (mgr.25142) 270 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:14 smithi089 bash[26514]: cephadm 2024-09-21T05:30:12.740383+0000 mgr.y (mgr.25142) 271 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:30:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:14 smithi110 bash[70834]: cluster 2024-09-21T05:30:12.709091+0000 mgr.y (mgr.25142) 270 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:14 smithi110 bash[70834]: cluster 2024-09-21T05:30:12.709091+0000 mgr.y (mgr.25142) 270 : cluster [DBG] pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:14 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.740383+0000 mgr.y (mgr.25142) 271 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:30:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:14 smithi110 bash[70834]: cephadm 2024-09-21T05:30:12.740383+0000 mgr.y (mgr.25142) 271 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:30:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:16.042779887Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:16.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:16] "GET /metrics HTTP/1.1" 200 38234 "" "Prometheus/2.51.0" 2024-09-21T05:30:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:16 smithi110 bash[70834]: cluster 2024-09-21T05:30:14.709764+0000 mgr.y (mgr.25142) 272 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:16 smithi110 bash[70834]: cluster 2024-09-21T05:30:14.709764+0000 mgr.y (mgr.25142) 272 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:16 smithi110 bash[70834]: audit 2024-09-21T05:30:15.551472+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:16 smithi110 bash[70834]: audit 2024-09-21T05:30:15.551472+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:16 smithi089 bash[19831]: cluster 2024-09-21T05:30:14.709764+0000 mgr.y (mgr.25142) 272 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:16 smithi089 bash[19831]: audit 2024-09-21T05:30:15.551472+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:16 smithi089 bash[26514]: cluster 2024-09-21T05:30:14.709764+0000 mgr.y (mgr.25142) 272 : cluster [DBG] pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:16 smithi089 bash[26514]: audit 2024-09-21T05:30:15.551472+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:30:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:18 smithi110 bash[70834]: cluster 2024-09-21T05:30:16.711405+0000 mgr.y (mgr.25142) 273 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:18 smithi110 bash[70834]: cluster 2024-09-21T05:30:16.711405+0000 mgr.y (mgr.25142) 273 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:18 smithi089 bash[19831]: cluster 2024-09-21T05:30:16.711405+0000 mgr.y (mgr.25142) 273 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:18 smithi089 bash[26514]: cluster 2024-09-21T05:30:16.711405+0000 mgr.y (mgr.25142) 273 : cluster [DBG] pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:19.029250452Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:19 smithi089 bash[19831]: audit 2024-09-21T05:30:18.209351+0000 mgr.y (mgr.25142) 274 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:19 smithi089 bash[26514]: audit 2024-09-21T05:30:18.209351+0000 mgr.y (mgr.25142) 274 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:19 smithi110 bash[70834]: audit 2024-09-21T05:30:18.209351+0000 mgr.y (mgr.25142) 274 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:19 smithi110 bash[70834]: audit 2024-09-21T05:30:18.209351+0000 mgr.y (mgr.25142) 274 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:20 smithi089 bash[19831]: cluster 2024-09-21T05:30:18.712127+0000 mgr.y (mgr.25142) 275 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:20 smithi089 bash[19831]: audit 2024-09-21T05:30:20.454237+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:20 smithi089 bash[26514]: cluster 2024-09-21T05:30:18.712127+0000 mgr.y (mgr.25142) 275 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:20 smithi089 bash[26514]: audit 2024-09-21T05:30:20.454237+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:20 smithi110 bash[70834]: cluster 2024-09-21T05:30:18.712127+0000 mgr.y (mgr.25142) 275 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:20 smithi110 bash[70834]: cluster 2024-09-21T05:30:18.712127+0000 mgr.y (mgr.25142) 275 : cluster [DBG] pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:20 smithi110 bash[70834]: audit 2024-09-21T05:30:20.454237+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:20 smithi110 bash[70834]: audit 2024-09-21T05:30:20.454237+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:22.038419988Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:22 smithi089 bash[19831]: cluster 2024-09-21T05:30:20.713770+0000 mgr.y (mgr.25142) 276 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:22 smithi089 bash[26514]: cluster 2024-09-21T05:30:20.713770+0000 mgr.y (mgr.25142) 276 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:23.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:22 smithi110 bash[70834]: cluster 2024-09-21T05:30:20.713770+0000 mgr.y (mgr.25142) 276 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:22 smithi110 bash[70834]: cluster 2024-09-21T05:30:20.713770+0000 mgr.y (mgr.25142) 276 : cluster [DBG] pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:24 smithi089 bash[19831]: cluster 2024-09-21T05:30:22.714437+0000 mgr.y (mgr.25142) 277 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:24 smithi089 bash[26514]: cluster 2024-09-21T05:30:22.714437+0000 mgr.y (mgr.25142) 277 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:25.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:24 smithi110 bash[70834]: cluster 2024-09-21T05:30:22.714437+0000 mgr.y (mgr.25142) 277 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:25.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:24 smithi110 bash[70834]: cluster 2024-09-21T05:30:22.714437+0000 mgr.y (mgr.25142) 277 : cluster [DBG] pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:25.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:30:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:25.024440647Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:26.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:25 smithi089 bash[26514]: audit 2024-09-21T05:30:24.365413+0000 mgr.y (mgr.25142) 278 : audit [DBG] from='client.25574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:26.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:25 smithi089 bash[19831]: audit 2024-09-21T05:30:24.365413+0000 mgr.y (mgr.25142) 278 : audit [DBG] from='client.25574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:25 smithi110 bash[70834]: audit 2024-09-21T05:30:24.365413+0000 mgr.y (mgr.25142) 278 : audit [DBG] from='client.25574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:25 smithi110 bash[70834]: audit 2024-09-21T05:30:24.365413+0000 mgr.y (mgr.25142) 278 : audit [DBG] from='client.25574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:26.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:26] "GET /metrics HTTP/1.1" 200 38233 "" "Prometheus/2.51.0" 2024-09-21T05:30:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:26 smithi089 bash[26514]: cluster 2024-09-21T05:30:24.715133+0000 mgr.y (mgr.25142) 279 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:26 smithi089 bash[19831]: cluster 2024-09-21T05:30:24.715133+0000 mgr.y (mgr.25142) 279 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:26 smithi110 bash[70834]: cluster 2024-09-21T05:30:24.715133+0000 mgr.y (mgr.25142) 279 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:26 smithi110 bash[70834]: cluster 2024-09-21T05:30:24.715133+0000 mgr.y (mgr.25142) 279 : cluster [DBG] pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:28.022012485Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:28 smithi089 bash[19831]: cluster 2024-09-21T05:30:26.716758+0000 mgr.y (mgr.25142) 280 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:28 smithi089 bash[26514]: cluster 2024-09-21T05:30:26.716758+0000 mgr.y (mgr.25142) 280 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:28 smithi110 bash[70834]: cluster 2024-09-21T05:30:26.716758+0000 mgr.y (mgr.25142) 280 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:28 smithi110 bash[70834]: cluster 2024-09-21T05:30:26.716758+0000 mgr.y (mgr.25142) 280 : cluster [DBG] pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:29.969 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:30:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:29 smithi089 bash[19831]: audit 2024-09-21T05:30:28.219579+0000 mgr.y (mgr.25142) 281 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:29 smithi089 bash[26514]: audit 2024-09-21T05:30:28.219579+0000 mgr.y (mgr.25142) 281 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:29 smithi110 bash[70834]: audit 2024-09-21T05:30:28.219579+0000 mgr.y (mgr.25142) 281 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:29 smithi110 bash[70834]: audit 2024-09-21T05:30:28.219579+0000 mgr.y (mgr.25142) 281 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:31.035 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:30 smithi110 bash[70834]: cluster 2024-09-21T05:30:28.717517+0000 mgr.y (mgr.25142) 282 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:31.035 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:30 smithi110 bash[70834]: cluster 2024-09-21T05:30:28.717517+0000 mgr.y (mgr.25142) 282 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:30 smithi089 bash[19831]: cluster 2024-09-21T05:30:28.717517+0000 mgr.y (mgr.25142) 282 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:30 smithi089 bash[26514]: cluster 2024-09-21T05:30:28.717517+0000 mgr.y (mgr.25142) 282 : cluster [DBG] pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:31.036818323Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (3m) 2m ago 29m 14.0M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (2m) 30s ago 29m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (4m) 2m ago 27m 47.7M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (4m) 30s ago 38m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (15m) 2m ago 40m 503M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (40m) 2m ago 40m 87.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (37s) 30s ago 38m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:30:31.444 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (38m) 2m ago 38m 62.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (4m) 2m ago 30m 7843k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (4m) 30s ago 30m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (37m) 2m ago 37m 58.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (36m) 2m ago 36m 68.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (35m) 2m ago 35m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (34m) 2m ago 34m 59.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (34m) 30s ago 34m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (33m) 30s ago 33m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (32m) 30s ago 32m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (31m) 30s ago 31m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (3m) 30s ago 30m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (27m) 2m ago 27m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:30:31.445 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (27m) 30s ago 27m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:30:32.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 2'"'"'' 2024-09-21T05:30:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:32 smithi089 bash[26514]: cluster 2024-09-21T05:30:30.719124+0000 mgr.y (mgr.25142) 283 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:32 smithi089 bash[26514]: audit 2024-09-21T05:30:31.406458+0000 mgr.y (mgr.25142) 284 : audit [DBG] from='client.25580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:32 smithi089 bash[19831]: cluster 2024-09-21T05:30:30.719124+0000 mgr.y (mgr.25142) 283 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:32 smithi089 bash[19831]: audit 2024-09-21T05:30:31.406458+0000 mgr.y (mgr.25142) 284 : audit [DBG] from='client.25580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:32 smithi110 bash[70834]: cluster 2024-09-21T05:30:30.719124+0000 mgr.y (mgr.25142) 283 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:32 smithi110 bash[70834]: cluster 2024-09-21T05:30:30.719124+0000 mgr.y (mgr.25142) 283 : cluster [DBG] pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:32 smithi110 bash[70834]: audit 2024-09-21T05:30:31.406458+0000 mgr.y (mgr.25142) 284 : audit [DBG] from='client.25580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:32 smithi110 bash[70834]: audit 2024-09-21T05:30:31.406458+0000 mgr.y (mgr.25142) 284 : audit [DBG] from='client.25580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:34.043129304Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:35.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:34 smithi089 bash[19831]: cluster 2024-09-21T05:30:32.719945+0000 mgr.y (mgr.25142) 285 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:34 smithi089 bash[26514]: cluster 2024-09-21T05:30:32.719945+0000 mgr.y (mgr.25142) 285 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:34 smithi110 bash[70834]: cluster 2024-09-21T05:30:32.719945+0000 mgr.y (mgr.25142) 285 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:34 smithi110 bash[70834]: cluster 2024-09-21T05:30:32.719945+0000 mgr.y (mgr.25142) 285 : cluster [DBG] pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:35 smithi089 bash[19831]: audit 2024-09-21T05:30:35.454744+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:35 smithi089 bash[26514]: audit 2024-09-21T05:30:35.454744+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:36.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:35 smithi110 bash[70834]: audit 2024-09-21T05:30:35.454744+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:35 smithi110 bash[70834]: audit 2024-09-21T05:30:35.454744+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:36.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:36] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.51.0" 2024-09-21T05:30:36.944 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:30:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:36 smithi089 bash[19831]: cluster 2024-09-21T05:30:34.720783+0000 mgr.y (mgr.25142) 286 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:36 smithi089 bash[26514]: cluster 2024-09-21T05:30:34.720783+0000 mgr.y (mgr.25142) 286 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:37.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:36 smithi110 bash[70834]: cluster 2024-09-21T05:30:34.720783+0000 mgr.y (mgr.25142) 286 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:37.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:36 smithi110 bash[70834]: cluster 2024-09-21T05:30:34.720783+0000 mgr.y (mgr.25142) 286 : cluster [DBG] pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:37.05086744Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:38.440 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:30:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:38 smithi089 bash[19831]: cluster 2024-09-21T05:30:36.722509+0000 mgr.y (mgr.25142) 287 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:38 smithi089 bash[19831]: audit 2024-09-21T05:30:38.427821+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.89:0/2788565571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:38 smithi089 bash[26514]: cluster 2024-09-21T05:30:36.722509+0000 mgr.y (mgr.25142) 287 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:38 smithi089 bash[26514]: audit 2024-09-21T05:30:38.427821+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.89:0/2788565571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:38 smithi110 bash[70834]: cluster 2024-09-21T05:30:36.722509+0000 mgr.y (mgr.25142) 287 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:38 smithi110 bash[70834]: cluster 2024-09-21T05:30:36.722509+0000 mgr.y (mgr.25142) 287 : cluster [DBG] pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:38 smithi110 bash[70834]: audit 2024-09-21T05:30:38.427821+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.89:0/2788565571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:38 smithi110 bash[70834]: audit 2024-09-21T05:30:38.427821+0000 mon.a (mon.0) 1623 : audit [DBG] from='client.? 172.21.15.89:0/2788565571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:30:39.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:30:40.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:39 smithi110 bash[70834]: audit 2024-09-21T05:30:38.230661+0000 mgr.y (mgr.25142) 288 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:40.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:39 smithi110 bash[70834]: audit 2024-09-21T05:30:38.230661+0000 mgr.y (mgr.25142) 288 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:39 smithi089 bash[19831]: audit 2024-09-21T05:30:38.230661+0000 mgr.y (mgr.25142) 288 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:39 smithi089 bash[26514]: audit 2024-09-21T05:30:38.230661+0000 mgr.y (mgr.25142) 288 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:40.024197763Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:40 smithi089 bash[19831]: cluster 2024-09-21T05:30:38.723210+0000 mgr.y (mgr.25142) 289 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:40 smithi089 bash[26514]: cluster 2024-09-21T05:30:38.723210+0000 mgr.y (mgr.25142) 289 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:40 smithi110 bash[70834]: cluster 2024-09-21T05:30:38.723210+0000 mgr.y (mgr.25142) 289 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:40 smithi110 bash[70834]: cluster 2024-09-21T05:30:38.723210+0000 mgr.y (mgr.25142) 289 : cluster [DBG] pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:43.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:42 smithi110 bash[70834]: cluster 2024-09-21T05:30:40.724808+0000 mgr.y (mgr.25142) 290 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:43.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:42 smithi110 bash[70834]: cluster 2024-09-21T05:30:40.724808+0000 mgr.y (mgr.25142) 290 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:42 smithi089 bash[19831]: cluster 2024-09-21T05:30:40.724808+0000 mgr.y (mgr.25142) 290 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:42 smithi089 bash[26514]: cluster 2024-09-21T05:30:40.724808+0000 mgr.y (mgr.25142) 290 : cluster [DBG] pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:43.039297809Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:44.029 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:30:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:44 smithi089 bash[19831]: cluster 2024-09-21T05:30:42.725530+0000 mgr.y (mgr.25142) 291 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:44 smithi089 bash[26514]: cluster 2024-09-21T05:30:42.725530+0000 mgr.y (mgr.25142) 291 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:45.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:44 smithi110 bash[70834]: cluster 2024-09-21T05:30:42.725530+0000 mgr.y (mgr.25142) 291 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:44 smithi110 bash[70834]: cluster 2024-09-21T05:30:42.725530+0000 mgr.y (mgr.25142) 291 : cluster [DBG] pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:45.428 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:30:45.428 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:30:45.428 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:30:45.428 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:30:45.429 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:30:45.429 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:30:45.429 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:30:45.429 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:30:45.429 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:30:46.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:30:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:46.033718106Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:46.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:46] "GET /metrics HTTP/1.1" 200 38232 "" "Prometheus/2.51.0" 2024-09-21T05:30:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:46 smithi089 bash[19831]: cluster 2024-09-21T05:30:44.726215+0000 mgr.y (mgr.25142) 292 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:46 smithi089 bash[19831]: audit 2024-09-21T05:30:45.428141+0000 mgr.y (mgr.25142) 293 : audit [DBG] from='client.25592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:46 smithi089 bash[26514]: cluster 2024-09-21T05:30:44.726215+0000 mgr.y (mgr.25142) 292 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:46 smithi089 bash[26514]: audit 2024-09-21T05:30:45.428141+0000 mgr.y (mgr.25142) 293 : audit [DBG] from='client.25592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:46 smithi110 bash[70834]: cluster 2024-09-21T05:30:44.726215+0000 mgr.y (mgr.25142) 292 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:46 smithi110 bash[70834]: cluster 2024-09-21T05:30:44.726215+0000 mgr.y (mgr.25142) 292 : cluster [DBG] pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:46 smithi110 bash[70834]: audit 2024-09-21T05:30:45.428141+0000 mgr.y (mgr.25142) 293 : audit [DBG] from='client.25592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:46 smithi110 bash[70834]: audit 2024-09-21T05:30:45.428141+0000 mgr.y (mgr.25142) 293 : audit [DBG] from='client.25592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:30:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:48 smithi089 bash[19831]: cluster 2024-09-21T05:30:46.727794+0000 mgr.y (mgr.25142) 294 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:48 smithi089 bash[26514]: cluster 2024-09-21T05:30:46.727794+0000 mgr.y (mgr.25142) 294 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:49.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:48 smithi110 bash[70834]: cluster 2024-09-21T05:30:46.727794+0000 mgr.y (mgr.25142) 294 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:48 smithi110 bash[70834]: cluster 2024-09-21T05:30:46.727794+0000 mgr.y (mgr.25142) 294 : cluster [DBG] pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:49.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:49.06035685Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:49 smithi089 bash[19831]: audit 2024-09-21T05:30:48.239863+0000 mgr.y (mgr.25142) 295 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:49 smithi089 bash[26514]: audit 2024-09-21T05:30:48.239863+0000 mgr.y (mgr.25142) 295 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:49 smithi110 bash[70834]: audit 2024-09-21T05:30:48.239863+0000 mgr.y (mgr.25142) 295 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:49 smithi110 bash[70834]: audit 2024-09-21T05:30:48.239863+0000 mgr.y (mgr.25142) 295 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:51.032 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:30:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:50 smithi089 bash[19831]: cluster 2024-09-21T05:30:48.728457+0000 mgr.y (mgr.25142) 296 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:50 smithi089 bash[19831]: audit 2024-09-21T05:30:50.454971+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:50 smithi089 bash[26514]: cluster 2024-09-21T05:30:48.728457+0000 mgr.y (mgr.25142) 296 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:50 smithi089 bash[26514]: audit 2024-09-21T05:30:50.454971+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:50 smithi110 bash[70834]: cluster 2024-09-21T05:30:48.728457+0000 mgr.y (mgr.25142) 296 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:50 smithi110 bash[70834]: cluster 2024-09-21T05:30:48.728457+0000 mgr.y (mgr.25142) 296 : cluster [DBG] pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:50 smithi110 bash[70834]: audit 2024-09-21T05:30:50.454971+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:50 smithi110 bash[70834]: audit 2024-09-21T05:30:50.454971+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:30:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:52.053945454Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:52.504 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:30:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:52 smithi089 bash[19831]: cluster 2024-09-21T05:30:50.730218+0000 mgr.y (mgr.25142) 297 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:52 smithi089 bash[19831]: audit 2024-09-21T05:30:52.504844+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.15.89:0/1863371928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:30:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:52 smithi089 bash[26514]: cluster 2024-09-21T05:30:50.730218+0000 mgr.y (mgr.25142) 297 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:52 smithi089 bash[26514]: audit 2024-09-21T05:30:52.504844+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.15.89:0/1863371928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:30:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:52 smithi110 bash[70834]: cluster 2024-09-21T05:30:50.730218+0000 mgr.y (mgr.25142) 297 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:52 smithi110 bash[70834]: cluster 2024-09-21T05:30:50.730218+0000 mgr.y (mgr.25142) 297 : cluster [DBG] pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:52 smithi110 bash[70834]: audit 2024-09-21T05:30:52.504844+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.15.89:0/1863371928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:30:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:52 smithi110 bash[70834]: audit 2024-09-21T05:30:52.504844+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.15.89:0/1863371928' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T05:30:53.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '"'"'{print $2}'"'"')' 2024-09-21T05:30:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:54 smithi089 bash[19831]: cluster 2024-09-21T05:30:52.730973+0000 mgr.y (mgr.25142) 298 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:54 smithi089 bash[26514]: cluster 2024-09-21T05:30:52.730973+0000 mgr.y (mgr.25142) 298 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:54 smithi110 bash[70834]: cluster 2024-09-21T05:30:52.730973+0000 mgr.y (mgr.25142) 298 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:54 smithi110 bash[70834]: cluster 2024-09-21T05:30:52.730973+0000 mgr.y (mgr.25142) 298 : cluster [DBG] pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:55.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:55.0592922Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:55 smithi089 bash[19831]: cluster 2024-09-21T05:30:54.731690+0000 mgr.y (mgr.25142) 299 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:55 smithi089 bash[26514]: cluster 2024-09-21T05:30:54.731690+0000 mgr.y (mgr.25142) 299 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:56.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:55 smithi110 bash[70834]: cluster 2024-09-21T05:30:54.731690+0000 mgr.y (mgr.25142) 299 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:56.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:55 smithi110 bash[70834]: cluster 2024-09-21T05:30:54.731690+0000 mgr.y (mgr.25142) 299 : cluster [DBG] pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:30:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:30:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:30:56] "GET /metrics HTTP/1.1" 200 38236 "" "Prometheus/2.51.0" 2024-09-21T05:30:58.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:57 smithi110 bash[70834]: cluster 2024-09-21T05:30:56.733406+0000 mgr.y (mgr.25142) 300 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:58.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:57 smithi110 bash[70834]: cluster 2024-09-21T05:30:56.733406+0000 mgr.y (mgr.25142) 300 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:57 smithi089 bash[19831]: cluster 2024-09-21T05:30:56.733406+0000 mgr.y (mgr.25142) 300 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:57 smithi089 bash[26514]: cluster 2024-09-21T05:30:56.733406+0000 mgr.y (mgr.25142) 300 : cluster [DBG] pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:30:58.049 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:30:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:30:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:30:58.045498637Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:30:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:58 smithi110 bash[70834]: audit 2024-09-21T05:30:58.251286+0000 mgr.y (mgr.25142) 301 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:58 smithi110 bash[70834]: audit 2024-09-21T05:30:58.251286+0000 mgr.y (mgr.25142) 301 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:59.257 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:58 smithi089 bash[19831]: audit 2024-09-21T05:30:58.251286+0000 mgr.y (mgr.25142) 301 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:30:59.258 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:58 smithi089 bash[26514]: audit 2024-09-21T05:30:58.251286+0000 mgr.y (mgr.25142) 301 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:00.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:59 smithi089 bash[26514]: cluster 2024-09-21T05:30:58.734121+0000 mgr.y (mgr.25142) 302 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:00.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:30:59 smithi089 bash[26514]: audit 2024-09-21T05:30:59.586564+0000 mgr.y (mgr.25142) 303 : audit [DBG] from='client.25604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:00.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:59 smithi089 bash[19831]: cluster 2024-09-21T05:30:58.734121+0000 mgr.y (mgr.25142) 302 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:00.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:30:59 smithi089 bash[19831]: audit 2024-09-21T05:30:59.586564+0000 mgr.y (mgr.25142) 303 : audit [DBG] from='client.25604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:59 smithi110 bash[70834]: cluster 2024-09-21T05:30:58.734121+0000 mgr.y (mgr.25142) 302 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:59 smithi110 bash[70834]: cluster 2024-09-21T05:30:58.734121+0000 mgr.y (mgr.25142) 302 : cluster [DBG] pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:59 smithi110 bash[70834]: audit 2024-09-21T05:30:59.586564+0000 mgr.y (mgr.25142) 303 : audit [DBG] from='client.25604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:30:59 smithi110 bash[70834]: audit 2024-09-21T05:30:59.586564+0000 mgr.y (mgr.25142) 303 : audit [DBG] from='client.25604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:01.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:00 smithi089 bash[19831]: audit 2024-09-21T05:30:59.967192+0000 mgr.y (mgr.25142) 304 : audit [DBG] from='client.25610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:00 smithi089 bash[26514]: audit 2024-09-21T05:30:59.967192+0000 mgr.y (mgr.25142) 304 : audit [DBG] from='client.25610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:01.035886639Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:01.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:00 smithi110 bash[70834]: audit 2024-09-21T05:30:59.967192+0000 mgr.y (mgr.25142) 304 : audit [DBG] from='client.25610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:01.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:00 smithi110 bash[70834]: audit 2024-09-21T05:30:59.967192+0000 mgr.y (mgr.25142) 304 : audit [DBG] from='client.25610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "mon", "hosts": "smithi089", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:01.964 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:01 smithi089 bash[19831]: cluster 2024-09-21T05:31:00.735677+0000 mgr.y (mgr.25142) 305 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:01.964 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:01 smithi089 bash[26514]: cluster 2024-09-21T05:31:00.735677+0000 mgr.y (mgr.25142) 305 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:01 smithi110 bash[70834]: cluster 2024-09-21T05:31:00.735677+0000 mgr.y (mgr.25142) 305 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:01 smithi110 bash[70834]: cluster 2024-09-21T05:31:00.735677+0000 mgr.y (mgr.25142) 305 : cluster [DBG] pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:02.478 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:03.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:31:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[19831]: cephadm 2024-09-21T05:31:02.471254+0000 mgr.y (mgr.25142) 306 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:03.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[19831]: audit 2024-09-21T05:31:02.477623+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[19831]: audit 2024-09-21T05:31:03.228209+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[19831]: audit 2024-09-21T05:31:03.229164+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[19831]: audit 2024-09-21T05:31:03.235329+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[26514]: cephadm 2024-09-21T05:31:02.471254+0000 mgr.y (mgr.25142) 306 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[26514]: audit 2024-09-21T05:31:02.477623+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[26514]: audit 2024-09-21T05:31:03.228209+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[26514]: audit 2024-09-21T05:31:03.229164+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:03.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:03 smithi089 bash[26514]: audit 2024-09-21T05:31:03.235329+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: cephadm 2024-09-21T05:31:02.471254+0000 mgr.y (mgr.25142) 306 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: cephadm 2024-09-21T05:31:02.471254+0000 mgr.y (mgr.25142) 306 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:02.477623+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:02.477623+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.228209+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.228209+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.229164+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.229164+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.235329+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:03.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:03 smithi110 bash[70834]: audit 2024-09-21T05:31:03.235329+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:04.048385266Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:04.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:04 smithi089 bash[19831]: cluster 2024-09-21T05:31:02.736276+0000 mgr.y (mgr.25142) 307 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:04.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:04 smithi089 bash[19831]: cephadm 2024-09-21T05:31:03.332324+0000 mgr.y (mgr.25142) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:04.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:04 smithi089 bash[26514]: cluster 2024-09-21T05:31:02.736276+0000 mgr.y (mgr.25142) 307 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:04.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:04 smithi089 bash[26514]: cephadm 2024-09-21T05:31:03.332324+0000 mgr.y (mgr.25142) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:04.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:04 smithi110 bash[70834]: cluster 2024-09-21T05:31:02.736276+0000 mgr.y (mgr.25142) 307 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:04.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:04 smithi110 bash[70834]: cluster 2024-09-21T05:31:02.736276+0000 mgr.y (mgr.25142) 307 : cluster [DBG] pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:04.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:04 smithi110 bash[70834]: cephadm 2024-09-21T05:31:03.332324+0000 mgr.y (mgr.25142) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:04.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:04 smithi110 bash[70834]: cephadm 2024-09-21T05:31:03.332324+0000 mgr.y (mgr.25142) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:31:05.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:05 smithi089 bash[26514]: audit 2024-09-21T05:31:05.455634+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:31:05.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:05 smithi089 bash[19831]: audit 2024-09-21T05:31:05.455634+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:31:05.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:05 smithi110 bash[70834]: audit 2024-09-21T05:31:05.455634+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:31:05.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:05 smithi110 bash[70834]: audit 2024-09-21T05:31:05.455634+0000 mon.a (mon.0) 1630 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T05:31:06.505 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:06] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: cluster 2024-09-21T05:31:04.737007+0000 mgr.y (mgr.25142) 309 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.826206+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.828922+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.831283+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.838396+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.841384+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[26514]: audit 2024-09-21T05:31:05.842422+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: cluster 2024-09-21T05:31:04.737007+0000 mgr.y (mgr.25142) 309 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.826206+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.828922+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.831283+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.838396+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.841384+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:31:06.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:06 smithi089 bash[19831]: audit 2024-09-21T05:31:05.842422+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: cluster 2024-09-21T05:31:04.737007+0000 mgr.y (mgr.25142) 309 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: cluster 2024-09-21T05:31:04.737007+0000 mgr.y (mgr.25142) 309 : cluster [DBG] pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.826206+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.826206+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.828922+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.828922+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T05:31:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.831283+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.831283+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.838396+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.838396+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.841384+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.841384+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.842422+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-21T05:31:06.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:06 smithi110 bash[70834]: audit 2024-09-21T05:31:05.842422+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-09-21T05:31:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:07.029401897Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[19831]: cephadm 2024-09-21T05:31:05.826833+0000 mgr.y (mgr.25142) 310 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[19831]: cephadm 2024-09-21T05:31:05.826912+0000 mgr.y (mgr.25142) 311 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[19831]: cephadm 2024-09-21T05:31:05.832181+0000 mgr.y (mgr.25142) 312 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[19831]: cephadm 2024-09-21T05:31:05.843095+0000 mgr.y (mgr.25142) 313 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[26514]: cephadm 2024-09-21T05:31:05.826833+0000 mgr.y (mgr.25142) 310 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:31:07.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[26514]: cephadm 2024-09-21T05:31:05.826912+0000 mgr.y (mgr.25142) 311 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:31:07.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[26514]: cephadm 2024-09-21T05:31:05.832181+0000 mgr.y (mgr.25142) 312 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:31:07.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:07 smithi089 bash[26514]: cephadm 2024-09-21T05:31:05.843095+0000 mgr.y (mgr.25142) 313 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.826833+0000 mgr.y (mgr.25142) 310 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.826833+0000 mgr.y (mgr.25142) 310 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.826912+0000 mgr.y (mgr.25142) 311 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.826912+0000 mgr.y (mgr.25142) 311 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.832181+0000 mgr.y (mgr.25142) 312 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.832181+0000 mgr.y (mgr.25142) 312 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.843095+0000 mgr.y (mgr.25142) 313 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-09-21T05:31:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:07 smithi110 bash[70834]: cephadm 2024-09-21T05:31:05.843095+0000 mgr.y (mgr.25142) 313 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[19831]: cluster 2024-09-21T05:31:06.738740+0000 mgr.y (mgr.25142) 314 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[19831]: audit 2024-09-21T05:31:08.423980+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[19831]: audit 2024-09-21T05:31:08.426694+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[19831]: audit 2024-09-21T05:31:08.428171+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[19831]: audit 2024-09-21T05:31:08.429784+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[26514]: cluster 2024-09-21T05:31:06.738740+0000 mgr.y (mgr.25142) 314 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[26514]: audit 2024-09-21T05:31:08.423980+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[26514]: audit 2024-09-21T05:31:08.426694+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[26514]: audit 2024-09-21T05:31:08.428171+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:31:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:08 smithi089 bash[26514]: audit 2024-09-21T05:31:08.429784+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: cluster 2024-09-21T05:31:06.738740+0000 mgr.y (mgr.25142) 314 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: cluster 2024-09-21T05:31:06.738740+0000 mgr.y (mgr.25142) 314 : cluster [DBG] pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.423980+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.423980+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' 2024-09-21T05:31:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.426694+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:31:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.426694+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T05:31:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.428171+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:31:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.428171+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T05:31:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.429784+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:08.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:08 smithi110 bash[70834]: audit 2024-09-21T05:31:08.429784+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T05:31:08.826 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[19831]: audit 2024-09-21T05:31:08.262534+0000 mgr.y (mgr.25142) 315 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[19831]: cephadm 2024-09-21T05:31:08.418491+0000 mgr.y (mgr.25142) 316 : cephadm [INF] Upgrade: Updating mon.a 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[19831]: cephadm 2024-09-21T05:31:08.431732+0000 mgr.y (mgr.25142) 317 : cephadm [INF] Deploying daemon mon.a on smithi089 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[26514]: audit 2024-09-21T05:31:08.262534+0000 mgr.y (mgr.25142) 315 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[26514]: cephadm 2024-09-21T05:31:08.418491+0000 mgr.y (mgr.25142) 316 : cephadm [INF] Upgrade: Updating mon.a 2024-09-21T05:31:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:09 smithi089 bash[26514]: cephadm 2024-09-21T05:31:08.431732+0000 mgr.y (mgr.25142) 317 : cephadm [INF] Deploying daemon mon.a on smithi089 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: audit 2024-09-21T05:31:08.262534+0000 mgr.y (mgr.25142) 315 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: audit 2024-09-21T05:31:08.262534+0000 mgr.y (mgr.25142) 315 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: cephadm 2024-09-21T05:31:08.418491+0000 mgr.y (mgr.25142) 316 : cephadm [INF] Upgrade: Updating mon.a 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: cephadm 2024-09-21T05:31:08.418491+0000 mgr.y (mgr.25142) 316 : cephadm [INF] Upgrade: Updating mon.a 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: cephadm 2024-09-21T05:31:08.431732+0000 mgr.y (mgr.25142) 317 : cephadm [INF] Deploying daemon mon.a on smithi089 2024-09-21T05:31:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:09 smithi110 bash[70834]: cephadm 2024-09-21T05:31:08.431732+0000 mgr.y (mgr.25142) 317 : cephadm [INF] Deploying daemon mon.a on smithi089 2024-09-21T05:31:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:10.045905046Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:10.786 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:10 smithi089 bash[19831]: cluster 2024-09-21T05:31:08.739264+0000 mgr.y (mgr.25142) 318 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:10.787 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:10 smithi089 bash[26514]: cluster 2024-09-21T05:31:08.739264+0000 mgr.y (mgr.25142) 318 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:10 smithi110 bash[70834]: cluster 2024-09-21T05:31:08.739264+0000 mgr.y (mgr.25142) 318 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:10 smithi110 bash[70834]: cluster 2024-09-21T05:31:08.739264+0000 mgr.y (mgr.25142) 318 : cluster [DBG] pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:11.169 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:31:11.822 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:31:11.822 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (3m) 3m ago 30m 14.0M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:31:11.822 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (3m) 70s ago 30m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:31:11.822 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (5m) 3m ago 28m 47.7M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (5m) 70s ago 39m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (16m) 3m ago 41m 503M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (41m) 3m ago 41m 87.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 9ece8299bc27 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (77s) 70s ago 39m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (39m) 3m ago 39m 62.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 84c38e027e6e 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (4m) 3m ago 30m 7843k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (4m) 70s ago 30m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (38m) 3m ago 38m 58.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (37m) 3m ago 37m 68.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (36m) 3m ago 36m 63.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (35m) 3m ago 35m 59.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (34m) 70s ago 34m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (33m) 70s ago 33m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (32m) 70s ago 32m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (31m) 70s ago 32m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:31:11.823 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (4m) 70s ago 31m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:31:11.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (28m) 3m ago 28m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:31:11.824 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (28m) 70s ago 28m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:31:11.922 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.922 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.922 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.922 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.923 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.923 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.923 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.924 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:11.924 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:31:12.193 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:31:12.194 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:31:12.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:11 smithi089 systemd[1]: Stopping Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:31:12.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[19831]: debug 2024-09-21T05:31:12.029+0000 7f7adb2b5640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:31:12.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[19831]: debug 2024-09-21T05:31:12.029+0000 7f7adb2b5640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T05:31:12.207 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE Bus STOPPING 2024-09-21T05:31:12.487 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:31:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:31:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:31:12.487 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi089", 2024-09-21T05:31:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:31:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T05:31:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T05:31:12.488 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:31:12.488 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:31:12.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-21T05:31:12.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE Bus STOPPED 2024-09-21T05:31:12.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE Bus STARTING 2024-09-21T05:31:12.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE Serving on http://:::9283 2024-09-21T05:31:12.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[68019]: [21/Sep/2024:05:31:12] ENGINE Bus STARTED 2024-09-21T05:31:12.968 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[88246]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:31:12.968 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 bash[88343]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-a 2024-09-21T05:31:12.968 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T05:31:12.968 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: Stopped Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:31:13.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.297 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.298 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.298 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.298 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.299 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:13 smithi089 systemd[1]: Started Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:31:13.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:31:12 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:13.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:13.022308108Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.301+0000 7fae17414c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:31:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.301+0000 7fae17414c80 0 ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev), process ceph-mon, pid 7 2024-09-21T05:31:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.301+0000 7fae17414c80 0 pidfile_write: ignore empty --pid-file 2024-09-21T05:31:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 0 load: jerasure load: lrc 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Git sha 0 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Compile date 2024-09-20 23:32:13 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: DB SUMMARY 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: DB Session ID: CFOQWV2RAOPBI41LNJQP 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: CURRENT file: CURRENT 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: MANIFEST file: MANIFEST-000015 size: 4675 Bytes 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000071.sst 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000069.log size: 644257 ; 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T05:31:14.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.create_if_missing: 0 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.env: 0x55f063ea8120 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.info_log: 0x55f0657e5700 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.statistics: (nil) 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.use_fsync: 0 2024-09-21T05:31:14.549 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:31:14.550 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.db_log_dir: 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.wal_dir: 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.write_buffer_manager: 0x55f0657e81e0 2024-09-21T05:31:14.551 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.unordered_write: 0 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.row_cache: None 2024-09-21T05:31:14.552 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.wal_filter: None 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.wal_compression: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:31:14.553 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:31:14.554 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_open_files: -1 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Compression algorithms supported: 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kZSTD supported: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T05:31:14.555 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:31:14.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T05:31:14.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:31:14.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:31:14.556 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.merge_operator: 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_filter: None 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f0657e5320) 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: cache_index_and_filter_blocks: 1 2024-09-21T05:31:14.557 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: pin_top_level_index_and_filter: 1 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: index_type: 0 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: data_block_index_type: 0 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: index_shortening: 1 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: checksum: 4 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: no_block_cache: 0 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_cache: 0x55f0657db610 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_cache_name: BinnedLRUCache 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_cache_options: 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: capacity : 536870912 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: num_shard_bits : 4 2024-09-21T05:31:14.558 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: strict_capacity_limit : 0 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: high_pri_pool_ratio: 0.000 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_cache_compressed: (nil) 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: persistent_cache: (nil) 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_size: 4096 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_size_deviation: 10 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_restart_interval: 16 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: index_block_restart_interval: 1 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: metadata_block_size: 4096 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: partition_filters: 0 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: use_delta_encoding: 1 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: filter_policy: bloomfilter 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: whole_key_filtering: 1 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: verify_compression: 0 2024-09-21T05:31:14.559 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: read_amp_bytes_per_bit: 0 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: format_version: 5 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: enable_index_compression: 1 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: block_align: 0 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: max_auto_readahead_size: 262144 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: prepopulate_block_cache: 0 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: initial_auto_readahead_size: 8192 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: num_file_reads_for_auto_readahead: 2 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression: NoCompression 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:31:14.560 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.num_levels: 7 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:31:14.561 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:31:14.562 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:31:14.563 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:31:14.564 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.ttl: 2592000 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T05:31:14.565 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 73, last_sequence is 32715, log_number is 69,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 69 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 69 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.305+0000 7fae17414c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7b12203a-1f6b-4340-aa46-326ca086f16b 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.309+0000 7fae17414c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896674309658, "job": 1, "event": "recovery_started", "wal_files": [69]} 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.309+0000 7fae17414c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #69 mode 2 2024-09-21T05:31:14.566 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.313+0000 7fae17414c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896674314296, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 74, "file_size": 632942, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 32716, "largest_seqno": 33265, "table_properties": {"data_size": 629845, "index_size": 1481, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 5135, "raw_average_key_size": 22, "raw_value_size": 624935, "raw_average_value_size": 2728, "num_data_blocks": 67, "num_entries": 229, "num_filter_entries": 229, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726896674, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7b12203a-1f6b-4340-aa46-326ca086f16b", "db_session_id": "CFOQWV2RAOPBI41LNJQP", "orig_file_number": 74, "seqno_to_time_mapping": "N/A"}} 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.313+0000 7fae17414c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896674314465, "job": 1, "event": "recovery_finished"} 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.313+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 76 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.313+0000 7fae17414c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae17414c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000069.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae17414c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f065808e00 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae17414c80 4 rocksdb: DB pointer 0x55f06590c000 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae0d1dc640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae0d1dc640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: ** DB Stats ** 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:14.567 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: ** Compaction Stats [default] ** 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: L0 1/0 618.11 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 191.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: L6 1/0 10.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Sum 2/0 10.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 191.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 191.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: ** Compaction Stats [default] ** 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 191.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-21T05:31:14.568 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Flush(GB): cumulative 0.001, interval 0.001 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Cumulative compaction: 0.00 GB write, 57.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Interval compaction: 0.00 GB write, 57.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Block cache BinnedLRUCache@0x55f0657db610#7 capacity: 512.00 MB usage: 2.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012517%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae17414c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:14.569 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.317+0000 7fae17414c80 1 mon.a@-1(???) e3 preinit fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).mds e1 new map 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).mds e1 print_map 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: e1 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: btime 2024-09-21T04:49:45:405505+0000 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: legacy client fscid: -1 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: No filesystems configured 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 0 mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:14.570 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:14 smithi089 bash[88398]: debug 2024-09-21T05:31:14.321+0000 7fae17414c80 1 mon.a@-1(???).paxosservice(auth 1..30) refresh upgraded, format 0 -> 3 2024-09-21T05:31:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.043290+0000 mon.b (mon.1) 2 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.043290+0000 mon.b (mon.1) 2 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.045120+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.045120+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.046863+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.046863+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.193510+0000 mon.b (mon.1) 5 : audit [DBG] from='client.15759 172.21.15.89:0/1986029520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.193510+0000 mon.b (mon.1) 5 : audit [DBG] from='client.15759 172.21.15.89:0/1986029520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.209677+0000 mgr.y (mgr.25142) 323 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.209677+0000 mgr.y (mgr.25142) 323 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.209998+0000 mon.b (mon.1) 6 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.209998+0000 mon.b (mon.1) 6 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T05:31:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.487288+0000 mgr.y (mgr.25142) 324 : audit [DBG] from='client.25640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:12.487288+0000 mgr.y (mgr.25142) 324 : audit [DBG] from='client.25640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:12.741500+0000 mgr.y (mgr.25142) 325 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:12.741500+0000 mgr.y (mgr.25142) 325 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:14.742194+0000 mgr.y (mgr.25142) 326 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:14.742194+0000 mgr.y (mgr.25142) 326 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.043290+0000 mon.b (mon.1) 2 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.045120+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.046863+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:31:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.193510+0000 mon.b (mon.1) 5 : audit [DBG] from='client.15759 172.21.15.89:0/1986029520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.209677+0000 mgr.y (mgr.25142) 323 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.209998+0000 mon.b (mon.1) 6 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:12.487288+0000 mgr.y (mgr.25142) 324 : audit [DBG] from='client.25640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:12.741500+0000 mgr.y (mgr.25142) 325 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:14.742194+0000 mgr.y (mgr.25142) 326 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.744151+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.764099+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.773914+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.773947+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.773964+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.773979+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.774001+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.774026+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.774057+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.774076+0000 mon.a (mon.0) 10 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.774095+0000 mon.a (mon.0) 11 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.775337+0000 mon.a (mon.0) 12 : cluster [DBG] fsmap 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.775392+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.777821+0000 mon.a (mon.0) 14 : cluster [DBG] mgrmap e42: y(active, since 5m), standbys: x 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: cluster 2024-09-21T05:31:15.778219+0000 mon.a (mon.0) 15 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:15.806465+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.25142 ' entity='' 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[26514]: audit 2024-09-21T05:31:15.822246+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.744151+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.744151+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.764099+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.764099+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773914+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773914+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773947+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773947+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773964+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773964+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773979+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.773979+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774001+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774001+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774026+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774026+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774057+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774057+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774076+0000 mon.a (mon.0) 10 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774076+0000 mon.a (mon.0) 10 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774095+0000 mon.a (mon.0) 11 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.774095+0000 mon.a (mon.0) 11 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.775337+0000 mon.a (mon.0) 12 : cluster [DBG] fsmap 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.775337+0000 mon.a (mon.0) 12 : cluster [DBG] fsmap 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.775392+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.775392+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.777821+0000 mon.a (mon.0) 14 : cluster [DBG] mgrmap e42: y(active, since 5m), standbys: x 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.777821+0000 mon.a (mon.0) 14 : cluster [DBG] mgrmap e42: y(active, since 5m), standbys: x 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.778219+0000 mon.a (mon.0) 15 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:16.203 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: cluster 2024-09-21T05:31:15.778219+0000 mon.a (mon.0) 15 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:15.806465+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.25142 ' entity='' 2024-09-21T05:31:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:15.806465+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.25142 ' entity='' 2024-09-21T05:31:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:15.822246+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:15 smithi089 bash[88398]: audit 2024-09-21T05:31:15.822246+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:16.043108918Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.043290+0000 mon.b (mon.1) 2 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.043290+0000 mon.b (mon.1) 2 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.045120+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.045120+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.046863+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.046863+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T05:31:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.193510+0000 mon.b (mon.1) 5 : audit [DBG] from='client.15759 172.21.15.89:0/1986029520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.193510+0000 mon.b (mon.1) 5 : audit [DBG] from='client.15759 172.21.15.89:0/1986029520' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.209677+0000 mgr.y (mgr.25142) 323 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.209677+0000 mgr.y (mgr.25142) 323 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.209998+0000 mon.b (mon.1) 6 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.209998+0000 mon.b (mon.1) 6 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.487288+0000 mgr.y (mgr.25142) 324 : audit [DBG] from='client.25640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:12.487288+0000 mgr.y (mgr.25142) 324 : audit [DBG] from='client.25640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:12.741500+0000 mgr.y (mgr.25142) 325 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:12.741500+0000 mgr.y (mgr.25142) 325 : cluster [DBG] pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:14.742194+0000 mgr.y (mgr.25142) 326 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:14.742194+0000 mgr.y (mgr.25142) 326 : cluster [DBG] pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.744151+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.744151+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.764099+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.764099+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773914+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773914+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773947+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773947+0000 mon.a (mon.0) 4 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773964+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773964+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773979+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.773979+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774001+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774001+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774026+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774026+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774057+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774057+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774076+0000 mon.a (mon.0) 10 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774076+0000 mon.a (mon.0) 10 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774095+0000 mon.a (mon.0) 11 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.774095+0000 mon.a (mon.0) 11 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.775337+0000 mon.a (mon.0) 12 : cluster [DBG] fsmap 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.775337+0000 mon.a (mon.0) 12 : cluster [DBG] fsmap 2024-09-21T05:31:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.775392+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.775392+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.777821+0000 mon.a (mon.0) 14 : cluster [DBG] mgrmap e42: y(active, since 5m), standbys: x 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.777821+0000 mon.a (mon.0) 14 : cluster [DBG] mgrmap e42: y(active, since 5m), standbys: x 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.778219+0000 mon.a (mon.0) 15 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: cluster 2024-09-21T05:31:15.778219+0000 mon.a (mon.0) 15 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:15.806465+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.25142 ' entity='' 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:15.806465+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.25142 ' entity='' 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:15.822246+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:15 smithi110 bash[70834]: audit 2024-09-21T05:31:15.822246+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:16] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:31:18.274 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:17 smithi089 bash[26514]: cluster 2024-09-21T05:31:16.743840+0000 mgr.y (mgr.25142) 327 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:18.274 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:17 smithi089 bash[88398]: cluster 2024-09-21T05:31:16.743840+0000 mgr.y (mgr.25142) 327 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:18.274 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:17 smithi089 bash[88398]: cluster 2024-09-21T05:31:16.743840+0000 mgr.y (mgr.25142) 327 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:18.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:17 smithi110 bash[70834]: cluster 2024-09-21T05:31:16.743840+0000 mgr.y (mgr.25142) 327 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:18.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:17 smithi110 bash[70834]: cluster 2024-09-21T05:31:16.743840+0000 mgr.y (mgr.25142) 327 : cluster [DBG] pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:19.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:18 smithi089 bash[26514]: audit 2024-09-21T05:31:18.273732+0000 mgr.y (mgr.25142) 328 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:18 smithi089 bash[88398]: audit 2024-09-21T05:31:18.273732+0000 mgr.y (mgr.25142) 328 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:19.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:18 smithi089 bash[88398]: audit 2024-09-21T05:31:18.273732+0000 mgr.y (mgr.25142) 328 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:19.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:19.04180962Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:18 smithi110 bash[70834]: audit 2024-09-21T05:31:18.273732+0000 mgr.y (mgr.25142) 328 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:18 smithi110 bash[70834]: audit 2024-09-21T05:31:18.273732+0000 mgr.y (mgr.25142) 328 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:19.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:19 smithi089 bash[68019]: debug 2024-09-21T05:31:19.333+0000 7f1a88244640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T05:31:20.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:19 smithi089 bash[26514]: cluster 2024-09-21T05:31:18.744639+0000 mgr.y (mgr.25142) 329 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:20.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:19 smithi089 bash[88398]: cluster 2024-09-21T05:31:18.744639+0000 mgr.y (mgr.25142) 329 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:20.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:19 smithi089 bash[88398]: cluster 2024-09-21T05:31:18.744639+0000 mgr.y (mgr.25142) 329 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:20.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:19 smithi110 bash[70834]: cluster 2024-09-21T05:31:18.744639+0000 mgr.y (mgr.25142) 329 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:20.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:19 smithi110 bash[70834]: cluster 2024-09-21T05:31:18.744639+0000 mgr.y (mgr.25142) 329 : cluster [DBG] pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:21.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:20 smithi089 bash[88398]: audit 2024-09-21T05:31:20.457110+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:21.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:20 smithi089 bash[88398]: audit 2024-09-21T05:31:20.457110+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:21.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:20 smithi089 bash[26514]: audit 2024-09-21T05:31:20.457110+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:21.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:20 smithi110 bash[70834]: audit 2024-09-21T05:31:20.457110+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:21.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:20 smithi110 bash[70834]: audit 2024-09-21T05:31:20.457110+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:22.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[26514]: cluster 2024-09-21T05:31:20.746623+0000 mgr.y (mgr.25142) 330 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:22.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[26514]: audit 2024-09-21T05:31:21.762237+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[26514]: audit 2024-09-21T05:31:21.773667+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: cluster 2024-09-21T05:31:20.746623+0000 mgr.y (mgr.25142) 330 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: cluster 2024-09-21T05:31:20.746623+0000 mgr.y (mgr.25142) 330 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: audit 2024-09-21T05:31:21.762237+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: audit 2024-09-21T05:31:21.762237+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: audit 2024-09-21T05:31:21.773667+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:21 smithi089 bash[88398]: audit 2024-09-21T05:31:21.773667+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:22.027577926Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: cluster 2024-09-21T05:31:20.746623+0000 mgr.y (mgr.25142) 330 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: cluster 2024-09-21T05:31:20.746623+0000 mgr.y (mgr.25142) 330 : cluster [DBG] pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: audit 2024-09-21T05:31:21.762237+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: audit 2024-09-21T05:31:21.762237+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: audit 2024-09-21T05:31:21.773667+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:22.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:21 smithi110 bash[70834]: audit 2024-09-21T05:31:21.773667+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[26514]: cluster 2024-09-21T05:31:22.747290+0000 mgr.y (mgr.25142) 331 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[26514]: audit 2024-09-21T05:31:22.852002+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[26514]: audit 2024-09-21T05:31:22.863209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: cluster 2024-09-21T05:31:22.747290+0000 mgr.y (mgr.25142) 331 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:24.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: cluster 2024-09-21T05:31:22.747290+0000 mgr.y (mgr.25142) 331 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:24.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: audit 2024-09-21T05:31:22.852002+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: audit 2024-09-21T05:31:22.852002+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: audit 2024-09-21T05:31:22.863209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:23 smithi089 bash[88398]: audit 2024-09-21T05:31:22.863209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: cluster 2024-09-21T05:31:22.747290+0000 mgr.y (mgr.25142) 331 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: cluster 2024-09-21T05:31:22.747290+0000 mgr.y (mgr.25142) 331 : cluster [DBG] pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: audit 2024-09-21T05:31:22.852002+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: audit 2024-09-21T05:31:22.852002+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: audit 2024-09-21T05:31:22.863209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:23 smithi110 bash[70834]: audit 2024-09-21T05:31:22.863209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:25.044319538Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:26.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:25 smithi089 bash[88398]: cluster 2024-09-21T05:31:24.747976+0000 mgr.y (mgr.25142) 332 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:26.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:25 smithi089 bash[88398]: cluster 2024-09-21T05:31:24.747976+0000 mgr.y (mgr.25142) 332 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:26.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:25 smithi089 bash[26514]: cluster 2024-09-21T05:31:24.747976+0000 mgr.y (mgr.25142) 332 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:25 smithi110 bash[70834]: cluster 2024-09-21T05:31:24.747976+0000 mgr.y (mgr.25142) 332 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:25 smithi110 bash[70834]: cluster 2024-09-21T05:31:24.747976+0000 mgr.y (mgr.25142) 332 : cluster [DBG] pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:26] "GET /metrics HTTP/1.1" 200 38230 "" "Prometheus/2.51.0" 2024-09-21T05:31:28.280 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:27 smithi089 bash[88398]: cluster 2024-09-21T05:31:26.749662+0000 mgr.y (mgr.25142) 333 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:28.280 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:27 smithi089 bash[88398]: cluster 2024-09-21T05:31:26.749662+0000 mgr.y (mgr.25142) 333 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:28.280 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:27 smithi089 bash[26514]: cluster 2024-09-21T05:31:26.749662+0000 mgr.y (mgr.25142) 333 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:27 smithi110 bash[70834]: cluster 2024-09-21T05:31:26.749662+0000 mgr.y (mgr.25142) 333 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:27 smithi110 bash[70834]: cluster 2024-09-21T05:31:26.749662+0000 mgr.y (mgr.25142) 333 : cluster [DBG] pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:28.052536126Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:29.185 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:28 smithi089 bash[88398]: audit 2024-09-21T05:31:28.279129+0000 mgr.y (mgr.25142) 334 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:29.185 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:28 smithi089 bash[88398]: audit 2024-09-21T05:31:28.279129+0000 mgr.y (mgr.25142) 334 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:29.186 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:28 smithi089 bash[26514]: audit 2024-09-21T05:31:28.279129+0000 mgr.y (mgr.25142) 334 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:28 smithi110 bash[70834]: audit 2024-09-21T05:31:28.279129+0000 mgr.y (mgr.25142) 334 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:29.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:28 smithi110 bash[70834]: audit 2024-09-21T05:31:28.279129+0000 mgr.y (mgr.25142) 334 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:30.135 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:29 smithi089 bash[88398]: cluster 2024-09-21T05:31:28.750325+0000 mgr.y (mgr.25142) 335 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:30.135 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:29 smithi089 bash[88398]: cluster 2024-09-21T05:31:28.750325+0000 mgr.y (mgr.25142) 335 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:30.135 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:29 smithi089 bash[26514]: cluster 2024-09-21T05:31:28.750325+0000 mgr.y (mgr.25142) 335 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:29 smithi110 bash[70834]: cluster 2024-09-21T05:31:28.750325+0000 mgr.y (mgr.25142) 335 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:29 smithi110 bash[70834]: cluster 2024-09-21T05:31:28.750325+0000 mgr.y (mgr.25142) 335 : cluster [DBG] pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:31:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:31.054595521Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:32.189 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:31 smithi089 bash[26514]: cluster 2024-09-21T05:31:30.751939+0000 mgr.y (mgr.25142) 336 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:32.189 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:31 smithi089 bash[88398]: cluster 2024-09-21T05:31:30.751939+0000 mgr.y (mgr.25142) 336 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:32.189 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:31 smithi089 bash[88398]: cluster 2024-09-21T05:31:30.751939+0000 mgr.y (mgr.25142) 336 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:31 smithi110 bash[70834]: cluster 2024-09-21T05:31:30.751939+0000 mgr.y (mgr.25142) 336 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:31 smithi110 bash[70834]: cluster 2024-09-21T05:31:30.751939+0000 mgr.y (mgr.25142) 336 : cluster [DBG] pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: cluster 2024-09-21T05:31:32.752743+0000 mgr.y (mgr.25142) 337 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:32.911020+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:32.929511+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:32.934740+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:32.937024+0000 mon.b (mon.1) 9 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:32.949953+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:33.086505+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:33.090397+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:33.092993+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T05:31:34.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: audit 2024-09-21T05:31:33.094903+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["c"]} : dispatch 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[26514]: cephadm 2024-09-21T05:31:33.095346+0000 mgr.y (mgr.25142) 338 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: cluster 2024-09-21T05:31:32.752743+0000 mgr.y (mgr.25142) 337 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: cluster 2024-09-21T05:31:32.752743+0000 mgr.y (mgr.25142) 337 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.911020+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.911020+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.929511+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.929511+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.934740+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.934740+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.937024+0000 mon.b (mon.1) 9 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.937024+0000 mon.b (mon.1) 9 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:34.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.949953+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:32.949953+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.086505+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.086505+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.090397+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.090397+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.092993+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.092993+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.094903+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["c"]} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: audit 2024-09-21T05:31:33.094903+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["c"]} : dispatch 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: cephadm 2024-09-21T05:31:33.095346+0000 mgr.y (mgr.25142) 338 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-09-21T05:31:34.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:33 smithi089 bash[88398]: cephadm 2024-09-21T05:31:33.095346+0000 mgr.y (mgr.25142) 338 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-09-21T05:31:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:34.029284963Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: cluster 2024-09-21T05:31:32.752743+0000 mgr.y (mgr.25142) 337 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: cluster 2024-09-21T05:31:32.752743+0000 mgr.y (mgr.25142) 337 : cluster [DBG] pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.911020+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.911020+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.929511+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.929511+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.934740+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.934740+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.937024+0000 mon.b (mon.1) 9 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.937024+0000 mon.b (mon.1) 9 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.949953+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:32.949953+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.086505+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.086505+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.090397+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.090397+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.092993+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.092993+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "quorum_status"} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.094903+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["c"]} : dispatch 2024-09-21T05:31:34.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: audit 2024-09-21T05:31:33.094903+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "mon ok-to-stop", "ids": ["c"]} : dispatch 2024-09-21T05:31:34.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: cephadm 2024-09-21T05:31:33.095346+0000 mgr.y (mgr.25142) 338 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-09-21T05:31:34.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:33 smithi110 bash[70834]: cephadm 2024-09-21T05:31:33.095346+0000 mgr.y (mgr.25142) 338 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-09-21T05:31:36.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: cluster 2024-09-21T05:31:34.753208+0000 mgr.y (mgr.25142) 339 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: audit 2024-09-21T05:31:35.457445+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: cephadm 2024-09-21T05:31:35.549286+0000 mgr.y (mgr.25142) 340 : cephadm [INF] Upgrade: Updating mon.c 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: audit 2024-09-21T05:31:35.555242+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: audit 2024-09-21T05:31:35.563753+0000 mon.b (mon.1) 15 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: audit 2024-09-21T05:31:35.565314+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: audit 2024-09-21T05:31:35.566714+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[26514]: cephadm 2024-09-21T05:31:35.567083+0000 mgr.y (mgr.25142) 341 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cluster 2024-09-21T05:31:34.753208+0000 mgr.y (mgr.25142) 339 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:36.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cluster 2024-09-21T05:31:34.753208+0000 mgr.y (mgr.25142) 339 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.457445+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.457445+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cephadm 2024-09-21T05:31:35.549286+0000 mgr.y (mgr.25142) 340 : cephadm [INF] Upgrade: Updating mon.c 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cephadm 2024-09-21T05:31:35.549286+0000 mgr.y (mgr.25142) 340 : cephadm [INF] Upgrade: Updating mon.c 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.555242+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.555242+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.563753+0000 mon.b (mon.1) 15 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.563753+0000 mon.b (mon.1) 15 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.565314+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.565314+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.566714+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: audit 2024-09-21T05:31:35.566714+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:36.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cephadm 2024-09-21T05:31:35.567083+0000 mgr.y (mgr.25142) 341 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T05:31:36.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:35 smithi089 bash[88398]: cephadm 2024-09-21T05:31:35.567083+0000 mgr.y (mgr.25142) 341 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T05:31:36.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cluster 2024-09-21T05:31:34.753208+0000 mgr.y (mgr.25142) 339 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cluster 2024-09-21T05:31:34.753208+0000 mgr.y (mgr.25142) 339 : cluster [DBG] pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.457445+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.457445+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cephadm 2024-09-21T05:31:35.549286+0000 mgr.y (mgr.25142) 340 : cephadm [INF] Upgrade: Updating mon.c 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cephadm 2024-09-21T05:31:35.549286+0000 mgr.y (mgr.25142) 340 : cephadm [INF] Upgrade: Updating mon.c 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.555242+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.555242+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.563753+0000 mon.b (mon.1) 15 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.563753+0000 mon.b (mon.1) 15 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.565314+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.565314+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.566714+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: audit 2024-09-21T05:31:35.566714+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:36.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cephadm 2024-09-21T05:31:35.567083+0000 mgr.y (mgr.25142) 341 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T05:31:36.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:35 smithi110 bash[70834]: cephadm 2024-09-21T05:31:35.567083+0000 mgr.y (mgr.25142) 341 : cephadm [INF] Deploying daemon mon.c on smithi089 2024-09-21T05:31:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:36] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:31:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:37.028219389Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:38.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:37 smithi089 bash[88398]: cluster 2024-09-21T05:31:36.754829+0000 mgr.y (mgr.25142) 342 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:38.292 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:37 smithi089 bash[88398]: cluster 2024-09-21T05:31:36.754829+0000 mgr.y (mgr.25142) 342 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:38.292 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:37 smithi089 bash[26514]: cluster 2024-09-21T05:31:36.754829+0000 mgr.y (mgr.25142) 342 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:38.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:37 smithi110 bash[70834]: cluster 2024-09-21T05:31:36.754829+0000 mgr.y (mgr.25142) 342 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:38.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:37 smithi110 bash[70834]: cluster 2024-09-21T05:31:36.754829+0000 mgr.y (mgr.25142) 342 : cluster [DBG] pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:38.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.547 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.547 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.547 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.548 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.548 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:38.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:38 smithi089 systemd[1]: Stopping Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:31:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:38 smithi089 bash[26514]: debug 2024-09-21T05:31:38.580+0000 7f16f4103640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:31:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:38 smithi089 bash[26514]: debug 2024-09-21T05:31:38.580+0000 7f16f4103640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:31:39.519 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 bash[91800]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-c 2024-09-21T05:31:39.519 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 bash[91861]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-c 2024-09-21T05:31:39.519 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T05:31:39.520 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: Stopped Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:31:39.797 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.798 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: Started Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:31:39.799 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.799 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.799 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.800 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:39.800 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:31:39 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:31:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:40.038903446Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.792+0000 7f1581b5ac80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-21T05:31:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.792+0000 7f1581b5ac80 0 ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev), process ceph-mon, pid 7 2024-09-21T05:31:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.792+0000 7f1581b5ac80 0 pidfile_write: ignore empty --pid-file 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 0 load: jerasure load: lrc 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: RocksDB version: 7.9.2 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Git sha 0 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Compile date 2024-09-20 23:32:13 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: DB SUMMARY 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: DB Session ID: WXLV7XRML3QMKF57WRUW 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: CURRENT file: CURRENT 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 4811 Bytes 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000069.sst 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000067.log size: 0 ; 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.error_if_exists: 0 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.create_if_missing: 0 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.paranoid_checks: 1 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T05:31:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.env: 0x56524e144120 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.info_log: 0x56524f33d700 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.statistics: (nil) 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.use_fsync: 0 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_log_file_size: 0 2024-09-21T05:31:41.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_fallocate: 1 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.use_direct_reads: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.db_log_dir: 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.wal_dir: 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T05:31:41.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.write_buffer_manager: 0x56524f3401e0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-21T05:31:41.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.unordered_write: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.row_cache: None 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.wal_filter: None 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.two_write_queues: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.wal_compression: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.atomic_flush: 0 2024-09-21T05:31:41.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.log_readahead_size: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_background_jobs: 2 2024-09-21T05:31:41.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_background_compactions: -1 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_subcompactions: 1 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-21T05:31:41.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_open_files: -1 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_background_flushes: -1 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Compression algorithms supported: 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kZSTD supported: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kXpressCompression supported: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kBZip2Compression supported: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kLZ4Compression supported: 1 2024-09-21T05:31:41.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kZlibCompression supported: 1 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: kSnappyCompression supported: 1 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.merge_operator: 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_filter: None 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56524f33d320) 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: cache_index_and_filter_blocks: 1 2024-09-21T05:31:41.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: pin_top_level_index_and_filter: 1 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: index_type: 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: data_block_index_type: 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: index_shortening: 1 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: data_block_hash_table_util_ratio: 0.750000 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: checksum: 4 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: no_block_cache: 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_cache: 0x56524f333610 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_cache_name: BinnedLRUCache 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_cache_options: 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: capacity : 536870912 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: num_shard_bits : 4 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: strict_capacity_limit : 0 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: high_pri_pool_ratio: 0.000 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_cache_compressed: (nil) 2024-09-21T05:31:41.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: persistent_cache: (nil) 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_size: 4096 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_size_deviation: 10 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_restart_interval: 16 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: index_block_restart_interval: 1 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: metadata_block_size: 4096 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: partition_filters: 0 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: use_delta_encoding: 1 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: filter_policy: bloomfilter 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: whole_key_filtering: 1 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: verify_compression: 0 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: read_amp_bytes_per_bit: 0 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: format_version: 5 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: enable_index_compression: 1 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: block_align: 0 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: max_auto_readahead_size: 262144 2024-09-21T05:31:41.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: prepopulate_block_cache: 0 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: initial_auto_readahead_size: 8192 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: num_file_reads_for_auto_readahead: 2 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression: NoCompression 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.num_levels: 7 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T05:31:41.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-21T05:31:41.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T05:31:41.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T05:31:41.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.inplace_update_support: 0 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T05:31:41.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.bloom_locality: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.max_successive_merges: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.ttl: 2592000 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enable_blob_files: false 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.min_blob_size: 0 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-21T05:31:41.064 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-21T05:31:41.065 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.796+0000 7f1581b5ac80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 71, last_sequence is 36431, log_number is 67,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 67 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 67 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5ea2208a-ab81-4b55-ae7f-e725bc12c962 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896700802364, "job": 1, "event": "recovery_started", "wal_files": [67]} 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #67 mode 2 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726896700802452, "job": 1, "event": "recovery_finished"} 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 73 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56524f360e00 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1581b5ac80 4 rocksdb: DB pointer 0x56524f464000 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1577922640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.800+0000 7f1577922640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: ** DB Stats ** 2024-09-21T05:31:41.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: ** Compaction Stats [default] ** 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: L6 1/0 9.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Sum 1/0 9.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: ** Compaction Stats [default] ** 2024-09-21T05:31:41.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: AddFile(Keys): cumulative 0, interval 0 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Block cache BinnedLRUCache@0x56524f333610#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.9e-05 secs_since: 0 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: ** File Read Latency Histogram By Level [default] ** 2024-09-21T05:31:41.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 starting mon.c rank 2 at public addrs [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] at bind addrs [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 1 mon.c@-1(???) e3 preinit fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).mds e1 new map 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).mds e1 print_map 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: e1 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: btime 2024-09-21T04:49:45:405505+0000 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: legacy client fscid: -1 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: No filesystems configured 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:41.069 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 0 mon.c@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-09-21T05:31:41.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:40 smithi089 bash[91918]: debug 2024-09-21T05:31:40.804+0000 7f1581b5ac80 1 mon.c@-1(???).paxosservice(auth 1..31) refresh upgraded, format 0 -> 3 2024-09-21T05:31:42.832 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[91918]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:42 smithi089 bash[88398]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:38.755457+0000 mgr.y (mgr.25142) 344 : cluster [DBG] pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:40.756497+0000 mgr.y (mgr.25142) 345 : cluster [DBG] pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.764255+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.765625+0000 mon.a (mon.0) 26 : cluster [INF] mon.a calling monitor election 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.789123+0000 mon.a (mon.0) 27 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798578+0000 mon.a (mon.0) 28 : cluster [DBG] monmap epoch 3 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798614+0000 mon.a (mon.0) 29 : cluster [DBG] fsid bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798648+0000 mon.a (mon.0) 30 : cluster [DBG] last_changed 2024-09-21T04:51:47.992950+0000 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798686+0000 mon.a (mon.0) 31 : cluster [DBG] created 2024-09-21T04:49:40.825749+0000 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798720+0000 mon.a (mon.0) 32 : cluster [DBG] min_mon_release 19 (squid) 2024-09-21T05:31:43.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798762+0000 mon.a (mon.0) 33 : cluster [DBG] election_strategy: 1 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798798+0000 mon.a (mon.0) 34 : cluster [DBG] 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798838+0000 mon.a (mon.0) 35 : cluster [DBG] 1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.798879+0000 mon.a (mon.0) 36 : cluster [DBG] 2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.818538+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.818590+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.819245+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e42: y(active, since 6m), standbys: x 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: cluster 2024-09-21T05:31:41.819528+0000 mon.a (mon.0) 40 : cluster [INF] overall HEALTH_OK 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:41.833173+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:41.846185+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:42.395498+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.058 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:42 smithi110 bash[70834]: audit 2024-09-21T05:31:42.406478+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:43.436 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:31:43.436 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (4m) 21s ago 31m 14.4M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:31:43.436 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (3m) 102s ago 30m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:31:43.436 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (5m) 21s ago 28m 48.8M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (5m) 102s ago 39m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (16m) 21s ago 41m 512M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (30s) 21s ago 41m 22.5M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (109s) 102s ago 40m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 starting - - - 2048M 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (5m) 21s ago 31m 7912k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (5m) 102s ago 31m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (38m) 21s ago 38m 58.7M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (37m) 21s ago 37m 68.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (37m) 21s ago 37m 63.9M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (36m) 21s ago 36m 59.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (35m) 102s ago 35m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:31:43.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (34m) 102s ago 34m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:31:43.438 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (33m) 102s ago 33m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:31:43.438 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (32m) 102s ago 32m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:31:43.438 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (4m) 102s ago 31m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:31:43.438 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (28m) 21s ago 28m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:31:43.438 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (29m) 102s ago 29m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:31:43.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:43.064524092Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:31:43.801 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:31:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:31:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T05:31:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 5 2024-09-21T05:31:43.802 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:31:43.802 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:31:44.103 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:31:44.103 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:31:44.103 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:31:44.103 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi089", 2024-09-21T05:31:44.104 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:31:44.104 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T05:31:44.104 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T05:31:44.104 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:31:44.104 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:31:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[88398]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:44.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:43 smithi089 bash[91918]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: cluster 2024-09-21T05:31:42.757220+0000 mgr.y (mgr.25142) 346 : cluster [DBG] pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:42.820100+0000 mgr.y (mgr.25142) 347 : audit [DBG] from='client.44100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.114137+0000 mgr.y (mgr.25142) 348 : audit [DBG] from='client.44106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.418508+0000 mgr.y (mgr.25142) 349 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:44.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:43 smithi110 bash[70834]: audit 2024-09-21T05:31:43.800959+0000 mon.a (mon.0) 45 : audit [DBG] from='client.? 172.21.15.89:0/427804740' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:45.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:44 smithi089 bash[88398]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:45.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:44 smithi089 bash[88398]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:45.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:44 smithi089 bash[91918]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:45.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:44 smithi089 bash[91918]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:45.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:44 smithi110 bash[70834]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:45.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:44 smithi110 bash[70834]: audit 2024-09-21T05:31:44.103134+0000 mgr.y (mgr.25142) 350 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:31:46.198 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:45 smithi089 bash[68019]: debug 2024-09-21T05:31:45.820+0000 7f1a88244640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T05:31:46.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:45 smithi089 bash[88398]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.199 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:45 smithi089 bash[88398]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:45 smithi089 bash[91918]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:45 smithi089 bash[91918]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:46.0293833Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:45 smithi110 bash[70834]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:45 smithi110 bash[70834]: cluster 2024-09-21T05:31:44.757978+0000 mgr.y (mgr.25142) 351 : cluster [DBG] pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:46] "GET /metrics HTTP/1.1" 200 38231 "" "Prometheus/2.51.0" 2024-09-21T05:31:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:47 smithi089 bash[88398]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:47 smithi089 bash[88398]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:47 smithi089 bash[91918]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:47 smithi089 bash[91918]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:48.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:47 smithi110 bash[70834]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:47 smithi110 bash[70834]: cluster 2024-09-21T05:31:46.759665+0000 mgr.y (mgr.25142) 352 : cluster [DBG] pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:49.295 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:49.038619893Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:49.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[88398]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:49 smithi089 bash[91918]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.294616+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.297866+0000 mgr.y (mgr.25142) 353 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:49.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:49 smithi110 bash[70834]: audit 2024-09-21T05:31:48.306632+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[88398]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:50 smithi089 bash[91918]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: cluster 2024-09-21T05:31:48.760364+0000 mgr.y (mgr.25142) 354 : cluster [DBG] pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: audit 2024-09-21T05:31:49.412989+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:50 smithi110 bash[70834]: audit 2024-09-21T05:31:49.423685+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:51 smithi089 bash[88398]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:51.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:51 smithi089 bash[88398]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:51 smithi089 bash[91918]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:51 smithi089 bash[91918]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:51.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:51 smithi110 bash[70834]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:51 smithi110 bash[70834]: audit 2024-09-21T05:31:50.457883+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:31:52.423 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:52.055361136Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:52 smithi089 bash[88398]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:52 smithi089 bash[88398]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:52 smithi089 bash[91918]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:52 smithi089 bash[91918]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:52 smithi110 bash[70834]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:52 smithi110 bash[70834]: cluster 2024-09-21T05:31:50.762007+0000 mgr.y (mgr.25142) 355 : cluster [DBG] pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:54 smithi089 bash[88398]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:54.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:54 smithi089 bash[88398]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:54 smithi089 bash[91918]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:54 smithi089 bash[91918]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:54 smithi110 bash[70834]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:54 smithi110 bash[70834]: cluster 2024-09-21T05:31:52.762660+0000 mgr.y (mgr.25142) 356 : cluster [DBG] pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:55.037817303Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:56.505 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:31:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:31:56] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.51.0" 2024-09-21T05:31:56.505 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:56 smithi089 bash[88398]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:56.506 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:56 smithi089 bash[88398]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:56.506 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:56 smithi089 bash[91918]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:56.506 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:56 smithi089 bash[91918]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:56 smithi110 bash[70834]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:56.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:56 smithi110 bash[70834]: cluster 2024-09-21T05:31:54.763472+0000 mgr.y (mgr.25142) 357 : cluster [DBG] pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:31:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:31:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:31:58.023216965Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:31:58.572 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:58 smithi089 bash[88398]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:58.572 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:58 smithi089 bash[88398]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:58.573 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:58 smithi089 bash[91918]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:58.573 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:58 smithi089 bash[91918]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:58 smithi110 bash[70834]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:58 smithi110 bash[70834]: cluster 2024-09-21T05:31:56.765115+0000 mgr.y (mgr.25142) 358 : cluster [DBG] pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:31:59.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[88398]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:31:59 smithi089 bash[91918]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:58.305997+0000 mgr.y (mgr.25142) 359 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.194488+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.210486+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.215206+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.217157+0000 mon.b (mon.1) 20 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.226903+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.359034+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.363088+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.366487+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.374257+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.380362+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.380649+0000 mon.b (mon.1) 24 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.387867+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.394427+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.394837+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.399920+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.406449+0000 mon.b (mon.1) 26 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.414032+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.422237+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:31:59.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:31:59 smithi110 bash[70834]: audit 2024-09-21T05:31:59.429863+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.810 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.819 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.820 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.821 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.822 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.823 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.824 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.825 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.826 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.827 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.830 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.831 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.832 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.833 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[88398]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cluster 2024-09-21T05:31:58.765866+0000 mgr.y (mgr.25142) 360 : cluster [DBG] pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.366995+0000 mgr.y (mgr.25142) 361 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.407285+0000 mgr.y (mgr.25142) 362 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.422974+0000 mgr.y (mgr.25142) 363 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.834 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.442059+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.455202+0000 mgr.y (mgr.25142) 364 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.462376+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.468846+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.469292+0000 mgr.y (mgr.25142) 365 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.473581+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.474020+0000 mon.b (mon.1) 30 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.835 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.476219+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.476647+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.480237+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.480962+0000 mgr.y (mgr.25142) 366 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.490228+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.497837+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.498538+0000 mgr.y (mgr.25142) 367 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.836 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.507785+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.516253+0000 mon.b (mon.1) 34 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.516871+0000 mgr.y (mgr.25142) 368 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.527958+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.536790+0000 mon.b (mon.1) 35 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.537578+0000 mgr.y (mgr.25142) 369 : cephadm [INF] Upgrade: Setting container_image for all node-exporter 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.542726+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.837 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.542852+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.545856+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.546174+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.551035+0000 mon.b (mon.1) 38 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.551745+0000 mgr.y (mgr.25142) 370 : cephadm [INF] Upgrade: Setting container_image for all prometheus 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.556528+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.556847+0000 mon.b (mon.1) 39 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.838 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.559976+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.560321+0000 mon.b (mon.1) 40 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.565153+0000 mon.b (mon.1) 41 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.565758+0000 mgr.y (mgr.25142) 371 : cephadm [INF] Upgrade: Setting container_image for all alertmanager 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.570204+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.570588+0000 mon.b (mon.1) 42 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.573157+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.839 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.573515+0000 mon.b (mon.1) 43 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.578259+0000 mon.b (mon.1) 44 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.578889+0000 mgr.y (mgr.25142) 372 : cephadm [INF] Upgrade: Setting container_image for all grafana 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.583389+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.583771+0000 mon.b (mon.1) 45 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.586500+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.586878+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.840 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.591173+0000 mon.b (mon.1) 47 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.591761+0000 mgr.y (mgr.25142) 373 : cephadm [INF] Upgrade: Setting container_image for all loki 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.596528+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.596611+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.599540+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.599907+0000 mon.b (mon.1) 49 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.604468+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.841 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.605154+0000 mgr.y (mgr.25142) 374 : cephadm [INF] Upgrade: Setting container_image for all promtail 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.610148+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.610519+0000 mon.b (mon.1) 51 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.a"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.613348+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.613705+0000 mon.b (mon.1) 52 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.c"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.615492+0000 mgr.y (mgr.25142) 375 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.620044+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.842 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.620346+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.630605+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.637353+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.637623+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.647607+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.654215+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.654556+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:32:00.843 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.664193+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.670848+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.671192+0000 mon.b (mon.1) 56 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.674163+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.674540+0000 mon.b (mon.1) 57 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.684133+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.690442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.844 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.690986+0000 mon.b (mon.1) 58 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.693553+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.694028+0000 mon.b (mon.1) 59 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.703567+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.710051+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.710477+0000 mon.b (mon.1) 60 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.713013+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.845 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.713417+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.720970+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.726508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.726908+0000 mon.b (mon.1) 62 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.846 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.847 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.848 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.849 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:00 smithi110 bash[70834]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.729761+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.850 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.730180+0000 mon.b (mon.1) 63 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.737526+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.742693+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.743119+0000 mon.b (mon.1) 64 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.749169+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.755131+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.755612+0000 mon.b (mon.1) 65 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.851 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.758034+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.758533+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.761178+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.761392+0000 mon.b (mon.1) 67 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.764018+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.764401+0000 mon.b (mon.1) 68 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.766908+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.767340+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.852 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.769814+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.770263+0000 mon.b (mon.1) 70 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.773256+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.773739+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.780998+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.784529+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.786548+0000 mon.b (mon.1) 73 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.853 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.798920+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.925633+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.927438+0000 mon.b (mon.1) 75 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:00.854 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:00 smithi089 bash[91918]: audit 2024-09-21T05:31:59.936579+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:01.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:01.063232694Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[88398]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[88398]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[88398]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[91918]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[91918]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:01 smithi089 bash[91918]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:01 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:01 smithi110 bash[70834]: cephadm 2024-09-21T05:31:59.771522+0000 mgr.y (mgr.25142) 376 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:32:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:01 smithi110 bash[70834]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:01 smithi110 bash[70834]: audit 2024-09-21T05:32:00.576403+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:32:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:02 smithi089 bash[88398]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:02 smithi089 bash[88398]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:02 smithi089 bash[91918]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:02 smithi089 bash[91918]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:02 smithi110 bash[70834]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:02 smithi110 bash[70834]: cluster 2024-09-21T05:32:00.767501+0000 mgr.y (mgr.25142) 377 : cluster [DBG] pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:04.041909689Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:04 smithi089 bash[88398]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:04 smithi089 bash[88398]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:04 smithi089 bash[91918]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:04 smithi089 bash[91918]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:04 smithi110 bash[70834]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:04 smithi110 bash[70834]: cluster 2024-09-21T05:32:02.768193+0000 mgr.y (mgr.25142) 378 : cluster [DBG] pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:05 smithi089 bash[88398]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:05 smithi089 bash[88398]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:05 smithi089 bash[91918]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:05 smithi089 bash[91918]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:05 smithi110 bash[70834]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:05 smithi110 bash[70834]: audit 2024-09-21T05:32:05.458269+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:06] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.51.0" 2024-09-21T05:32:07.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:06 smithi110 bash[70834]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:06 smithi110 bash[70834]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:06 smithi089 bash[88398]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:06 smithi089 bash[88398]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:06 smithi089 bash[91918]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:06 smithi089 bash[91918]: cluster 2024-09-21T05:32:04.768986+0000 mgr.y (mgr.25142) 379 : cluster [DBG] pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:07.030298347Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:08 smithi089 bash[88398]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:09.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:08 smithi089 bash[88398]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:08 smithi089 bash[91918]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:08 smithi089 bash[91918]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:08 smithi110 bash[70834]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:08 smithi110 bash[70834]: cluster 2024-09-21T05:32:06.770668+0000 mgr.y (mgr.25142) 380 : cluster [DBG] pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:10.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:09 smithi110 bash[70834]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:09 smithi110 bash[70834]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:09 smithi089 bash[88398]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:09 smithi089 bash[88398]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:09 smithi089 bash[91918]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:09 smithi089 bash[91918]: audit 2024-09-21T05:32:08.314141+0000 mgr.y (mgr.25142) 381 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:10.01938812Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:10 smithi089 bash[88398]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:10 smithi089 bash[88398]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:10 smithi089 bash[91918]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:10 smithi089 bash[91918]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:10 smithi110 bash[70834]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:10 smithi110 bash[70834]: cluster 2024-09-21T05:32:08.771329+0000 mgr.y (mgr.25142) 382 : cluster [DBG] pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:12 smithi089 bash[91918]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:12 smithi089 bash[91918]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:12 smithi089 bash[88398]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:12 smithi089 bash[88398]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:12 smithi110 bash[70834]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:12 smithi110 bash[70834]: cluster 2024-09-21T05:32:10.772871+0000 mgr.y (mgr.25142) 383 : cluster [DBG] pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:13.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:13.069833195Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:14.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:14 smithi089 bash[88398]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:14.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:14 smithi089 bash[88398]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:14 smithi089 bash[91918]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:14 smithi089 bash[91918]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:14 smithi110 bash[70834]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:14 smithi110 bash[70834]: cluster 2024-09-21T05:32:12.773559+0000 mgr.y (mgr.25142) 384 : cluster [DBG] pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:15.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:32:16.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:15 smithi089 bash[88398]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:15 smithi089 bash[88398]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:15 smithi089 bash[91918]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:15 smithi089 bash[91918]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:15 smithi110 bash[70834]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:15 smithi110 bash[70834]: audit 2024-09-21T05:32:14.435333+0000 mgr.y (mgr.25142) 385 : audit [DBG] from='client.54104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:16.050064902Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:16] "GET /metrics HTTP/1.1" 200 38226 "" "Prometheus/2.51.0" 2024-09-21T05:32:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:16 smithi089 bash[91918]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:16 smithi089 bash[91918]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:16 smithi089 bash[88398]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:16 smithi089 bash[88398]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:16 smithi110 bash[70834]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:16 smithi110 bash[70834]: cluster 2024-09-21T05:32:14.774273+0000 mgr.y (mgr.25142) 386 : cluster [DBG] pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:18 smithi089 bash[88398]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:18 smithi089 bash[88398]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:18 smithi089 bash[91918]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:18 smithi089 bash[91918]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:18 smithi110 bash[70834]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:18 smithi110 bash[70834]: cluster 2024-09-21T05:32:16.775901+0000 mgr.y (mgr.25142) 387 : cluster [DBG] pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:19.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:19.061577128Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:19 smithi089 bash[88398]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:20.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:19 smithi089 bash[88398]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:19 smithi089 bash[91918]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:19 smithi089 bash[91918]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:19 smithi110 bash[70834]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:19 smithi110 bash[70834]: audit 2024-09-21T05:32:18.325280+0000 mgr.y (mgr.25142) 388 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[88398]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[88398]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[88398]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[88398]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[91918]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[91918]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[91918]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:20 smithi089 bash[91918]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:20 smithi110 bash[70834]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:20 smithi110 bash[70834]: cluster 2024-09-21T05:32:18.776566+0000 mgr.y (mgr.25142) 389 : cluster [DBG] pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:20 smithi110 bash[70834]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:20 smithi110 bash[70834]: audit 2024-09-21T05:32:20.458739+0000 mon.b (mon.1) 77 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:21.708 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:32:21.708 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (4m) 33s ago 31m 13.8M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (4m) 2m ago 31m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (6m) 33s ago 29m 48.9M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (6m) 2m ago 40m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (17m) 33s ago 42m 512M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (68s) 33s ago 42m 39.9M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (2m) 2m ago 40m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (41s) 33s ago 40m 18.7M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (5m) 33s ago 32m 8500k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (5m) 2m ago 32m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (39m) 33s ago 39m 58.8M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (38m) 33s ago 38m 68.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (37m) 33s ago 37m 64.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:32:21.709 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (36m) 33s ago 36m 59.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (35m) 2m ago 35m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (34m) 2m ago 35m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (34m) 2m ago 34m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (33m) 2m ago 33m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (5m) 2m ago 32m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (29m) 33s ago 29m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:32:21.710 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (29m) 2m ago 29m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:32:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:22.04593104Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:22.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 1'"'"'' 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[88398]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[88398]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[88398]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[88398]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[91918]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[91918]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[91918]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:22 smithi089 bash[91918]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:22 smithi110 bash[70834]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:22 smithi110 bash[70834]: cluster 2024-09-21T05:32:20.778250+0000 mgr.y (mgr.25142) 390 : cluster [DBG] pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:22 smithi110 bash[70834]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:22 smithi110 bash[70834]: audit 2024-09-21T05:32:21.671093+0000 mgr.y (mgr.25142) 391 : audit [DBG] from='client.54110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:24 smithi089 bash[88398]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:24 smithi089 bash[88398]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:24 smithi089 bash[91918]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:24 smithi089 bash[91918]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:24 smithi110 bash[70834]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:24 smithi110 bash[70834]: cluster 2024-09-21T05:32:22.778888+0000 mgr.y (mgr.25142) 392 : cluster [DBG] pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:25.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:25.060783662Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:26] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:32:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:26 smithi089 bash[88398]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:26 smithi089 bash[88398]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:26 smithi089 bash[91918]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:26 smithi089 bash[91918]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:26 smithi110 bash[70834]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:26 smithi110 bash[70834]: cluster 2024-09-21T05:32:24.779588+0000 mgr.y (mgr.25142) 393 : cluster [DBG] pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:27.274 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:28.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:28.063353153Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:28.785 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:32:28.933 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:28 smithi089 bash[88398]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:28.934 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:28 smithi089 bash[88398]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:28.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:28 smithi089 bash[91918]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:28.934 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:28 smithi089 bash[91918]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:28 smithi110 bash[70834]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:28 smithi110 bash[70834]: cluster 2024-09-21T05:32:26.780909+0000 mgr.y (mgr.25142) 394 : cluster [DBG] pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:29.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.mon | keys'"'"' | grep $sha1' 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[88398]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[88398]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[88398]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[88398]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[91918]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[91918]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[91918]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:29.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:29 smithi089 bash[91918]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:29 smithi110 bash[70834]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:29 smithi110 bash[70834]: audit 2024-09-21T05:32:28.334329+0000 mgr.y (mgr.25142) 395 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:29 smithi110 bash[70834]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:29 smithi110 bash[70834]: audit 2024-09-21T05:32:28.773992+0000 mon.a (mon.0) 109 : audit [DBG] from='client.? 172.21.15.89:0/3739957777' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:30 smithi089 bash[88398]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:30 smithi089 bash[88398]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:30 smithi089 bash[91918]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:30 smithi089 bash[91918]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:30 smithi110 bash[70834]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:30 smithi110 bash[70834]: cluster 2024-09-21T05:32:28.781354+0000 mgr.y (mgr.25142) 396 : cluster [DBG] pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:31.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:31.068022391Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:32 smithi089 bash[88398]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:32 smithi089 bash[88398]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:32 smithi089 bash[91918]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:32 smithi089 bash[91918]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:32 smithi110 bash[70834]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:32 smithi110 bash[70834]: cluster 2024-09-21T05:32:30.782940+0000 mgr.y (mgr.25142) 397 : cluster [DBG] pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:34.025274761Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:34.304 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:34 smithi089 bash[88398]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:34 smithi089 bash[88398]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:34 smithi089 bash[91918]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:34 smithi089 bash[91918]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:34 smithi110 bash[70834]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:34 smithi110 bash[70834]: cluster 2024-09-21T05:32:32.783754+0000 mgr.y (mgr.25142) 398 : cluster [DBG] pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:35.905 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)" 2024-09-21T05:32:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:35 smithi089 bash[88398]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:35 smithi089 bash[88398]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:35 smithi089 bash[91918]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:35 smithi089 bash[91918]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:35 smithi110 bash[70834]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:35 smithi110 bash[70834]: audit 2024-09-21T05:32:35.458649+0000 mon.b (mon.1) 78 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:36] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:32:36.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 5'"'"'' 2024-09-21T05:32:37.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:36 smithi110 bash[70834]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:36 smithi110 bash[70834]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:36 smithi110 bash[70834]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:36 smithi110 bash[70834]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[88398]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[88398]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[88398]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[88398]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[91918]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[91918]: cluster 2024-09-21T05:32:34.784504+0000 mgr.y (mgr.25142) 399 : cluster [DBG] pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[91918]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:36 smithi089 bash[91918]: audit 2024-09-21T05:32:35.892667+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.89:0/3454633751' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:32:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:37.027589041Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:37 smithi089 bash[88398]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:38.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:37 smithi089 bash[88398]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:37 smithi089 bash[91918]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:37 smithi089 bash[91918]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:37 smithi110 bash[70834]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:37 smithi110 bash[70834]: cluster 2024-09-21T05:32:36.786227+0000 mgr.y (mgr.25142) 400 : cluster [DBG] pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:38 smithi089 bash[88398]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:38 smithi089 bash[88398]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:38 smithi089 bash[91918]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:38 smithi089 bash[91918]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:38 smithi110 bash[70834]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:38 smithi110 bash[70834]: audit 2024-09-21T05:32:38.342147+0000 mgr.y (mgr.25142) 401 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:40.021 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:39 smithi110 bash[70834]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.021 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:39 smithi110 bash[70834]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:39 smithi089 bash[88398]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:39 smithi089 bash[88398]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:39 smithi089 bash[91918]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:39 smithi089 bash[91918]: cluster 2024-09-21T05:32:38.787119+0000 mgr.y (mgr.25142) 402 : cluster [DBG] pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:40.022400557Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:41.461 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:42.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:41 smithi089 bash[91918]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:42.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:41 smithi089 bash[91918]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:41 smithi089 bash[88398]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:41 smithi089 bash[88398]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:42.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:41 smithi110 bash[70834]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:42.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:41 smithi110 bash[70834]: cluster 2024-09-21T05:32:40.788833+0000 mgr.y (mgr.25142) 403 : cluster [DBG] pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:32:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:43.050771993Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[88398]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[88398]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[88398]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[88398]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[91918]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[91918]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[91918]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:43 smithi089 bash[91918]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:43 smithi110 bash[70834]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:43 smithi110 bash[70834]: cluster 2024-09-21T05:32:42.789367+0000 mgr.y (mgr.25142) 404 : cluster [DBG] pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:43 smithi110 bash[70834]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:44.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:43 smithi110 bash[70834]: audit 2024-09-21T05:32:43.115110+0000 mgr.y (mgr.25142) 405 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:45.720 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:32:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:45 smithi089 bash[88398]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:45 smithi089 bash[88398]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:45 smithi089 bash[91918]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:45 smithi089 bash[91918]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:46.043524517Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:45 smithi110 bash[70834]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:45 smithi110 bash[70834]: cluster 2024-09-21T05:32:44.789858+0000 mgr.y (mgr.25142) 406 : cluster [DBG] pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:32:46.464 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:46] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:32:46.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:32:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:47 smithi089 bash[88398]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:47 smithi089 bash[88398]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:47 smithi089 bash[91918]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:47 smithi089 bash[91918]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:47 smithi110 bash[70834]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:48.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:47 smithi110 bash[70834]: cluster 2024-09-21T05:32:46.791467+0000 mgr.y (mgr.25142) 407 : cluster [DBG] pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:49.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:48 smithi089 bash[88398]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:49.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:48 smithi089 bash[88398]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:48 smithi089 bash[91918]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:49.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:48 smithi089 bash[91918]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:49.064315898Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:48 smithi110 bash[70834]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:49.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:48 smithi110 bash[70834]: audit 2024-09-21T05:32:48.351846+0000 mgr.y (mgr.25142) 408 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:50.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:49 smithi089 bash[88398]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:50.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:49 smithi089 bash[88398]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:50.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:49 smithi089 bash[91918]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:50.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:49 smithi089 bash[91918]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:49 smithi110 bash[70834]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:49 smithi110 bash[70834]: cluster 2024-09-21T05:32:48.792190+0000 mgr.y (mgr.25142) 409 : cluster [DBG] pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:32:51.280 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:50 smithi089 bash[88398]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:50 smithi089 bash[88398]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:51.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:50 smithi089 bash[91918]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:51.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:50 smithi089 bash[91918]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:50 smithi110 bash[70834]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:50 smithi110 bash[70834]: audit 2024-09-21T05:32:50.459284+0000 mon.b (mon.1) 79 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:32:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:51 smithi089 bash[88398]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:51 smithi089 bash[88398]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:51 smithi089 bash[91918]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:51 smithi089 bash[91918]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:52.044296575Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:51 smithi110 bash[70834]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:51 smithi110 bash[70834]: cluster 2024-09-21T05:32:50.793807+0000 mgr.y (mgr.25142) 410 : cluster [DBG] pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:53.002 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:32:53.002 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:32:53.002 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:32:53.002 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:32:53.002 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:32:53.003 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:32:53.003 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:32:53.003 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:32:53.003 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:32:53.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[88398]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[88398]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[88398]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[88398]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[91918]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[91918]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[91918]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:53 smithi089 bash[91918]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:53 smithi110 bash[70834]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:53 smithi110 bash[70834]: cluster 2024-09-21T05:32:52.794273+0000 mgr.y (mgr.25142) 411 : cluster [DBG] pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:53 smithi110 bash[70834]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:53 smithi110 bash[70834]: audit 2024-09-21T05:32:53.002351+0000 mgr.y (mgr.25142) 412 : audit [DBG] from='client.54134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:32:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:55.037522073Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:55 smithi089 bash[88398]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:55 smithi089 bash[88398]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:55 smithi089 bash[91918]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:55 smithi089 bash[91918]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:55 smithi110 bash[70834]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:55 smithi110 bash[70834]: cluster 2024-09-21T05:32:54.794933+0000 mgr.y (mgr.25142) 413 : cluster [DBG] pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-09-21T05:32:56.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:32:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:32:56] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:32:58.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:57 smithi089 bash[88398]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:57 smithi089 bash[88398]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:57 smithi089 bash[91918]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:57 smithi089 bash[91918]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:32:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:32:58.062190344Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:32:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:57 smithi110 bash[70834]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:57 smithi110 bash[70834]: cluster 2024-09-21T05:32:56.796656+0000 mgr.y (mgr.25142) 414 : cluster [DBG] pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-09-21T05:32:58.512 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:32:59.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:58 smithi089 bash[88398]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:59.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:58 smithi089 bash[88398]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:59.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:58 smithi089 bash[91918]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:59.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:58 smithi089 bash[91918]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:58 smithi110 bash[70834]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:32:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:58 smithi110 bash[70834]: audit 2024-09-21T05:32:58.363094+0000 mgr.y (mgr.25142) 415 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:59 smithi089 bash[88398]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:32:59 smithi089 bash[88398]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:59 smithi089 bash[91918]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:32:59 smithi089 bash[91918]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:00.218 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:33:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:59 smithi110 bash[70834]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:32:59 smithi110 bash[70834]: cluster 2024-09-21T05:32:58.797404+0000 mgr.y (mgr.25142) 416 : cluster [DBG] pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:01.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2' 2024-09-21T05:33:01.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[91918]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:01.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:00 smithi089 bash[88398]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:01.305 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:01.062295604Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.215701+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.89:0/4005493301' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.754495+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.755949+0000 mon.b (mon.1) 81 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:01.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:01.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:00 smithi110 bash[70834]: audit 2024-09-21T05:33:00.764930+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:02.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:01 smithi089 bash[88398]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:01 smithi089 bash[88398]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:01 smithi089 bash[91918]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:01 smithi089 bash[91918]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:01 smithi110 bash[70834]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:01 smithi110 bash[70834]: cluster 2024-09-21T05:33:00.798459+0000 mgr.y (mgr.25142) 417 : cluster [DBG] pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:33:04.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:03 smithi089 bash[91918]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:04.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:03 smithi089 bash[91918]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:03 smithi089 bash[88398]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:04.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:03 smithi089 bash[88398]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:04.060634113Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:03 smithi110 bash[70834]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:03 smithi110 bash[70834]: cluster 2024-09-21T05:33:02.799284+0000 mgr.y (mgr.25142) 418 : cluster [DBG] pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:05.843 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:33:06.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[91918]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[91918]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[91918]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[91918]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[88398]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[88398]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[88398]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:05 smithi089 bash[88398]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:05 smithi110 bash[70834]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:05 smithi110 bash[70834]: cluster 2024-09-21T05:33:04.800108+0000 mgr.y (mgr.25142) 419 : cluster [DBG] pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:05 smithi110 bash[70834]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:05 smithi110 bash[70834]: audit 2024-09-21T05:33:05.459986+0000 mon.b (mon.1) 82 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:06.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:06] "GET /metrics HTTP/1.1" 200 38228 "" "Prometheus/2.51.0" 2024-09-21T05:33:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:07.022322523Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[88398]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[88398]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[88398]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[88398]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[91918]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[91918]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[91918]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:08.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:07 smithi089 bash[91918]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:07 smithi110 bash[70834]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:07 smithi110 bash[70834]: cluster 2024-09-21T05:33:06.801515+0000 mgr.y (mgr.25142) 420 : cluster [DBG] pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:07 smithi110 bash[70834]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:07 smithi110 bash[70834]: audit 2024-09-21T05:33:07.414335+0000 mgr.y (mgr.25142) 421 : audit [DBG] from='client.54146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:09.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:08 smithi089 bash[88398]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:08 smithi089 bash[88398]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:08 smithi089 bash[91918]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:08 smithi089 bash[91918]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:08 smithi110 bash[70834]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:08 smithi110 bash[70834]: audit 2024-09-21T05:33:08.374230+0000 mgr.y (mgr.25142) 422 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:09.860 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[88398]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:09 smithi089 bash[91918]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:10.039233228Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: cluster 2024-09-21T05:33:08.802104+0000 mgr.y (mgr.25142) 423 : cluster [DBG] pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.857388+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.863155+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.864710+0000 mon.b (mon.1) 84 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:09 smithi110 bash[70834]: audit 2024-09-21T05:33:09.871627+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:10.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:33:10.948 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[91918]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:10.948 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[91918]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:10.948 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[91918]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:10.948 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[91918]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[88398]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[88398]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[88398]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:10 smithi089 bash[88398]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:10 smithi110 bash[70834]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:10 smithi110 bash[70834]: cephadm 2024-09-21T05:33:09.850892+0000 mgr.y (mgr.25142) 424 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:10 smithi110 bash[70834]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:11.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:10 smithi110 bash[70834]: cephadm 2024-09-21T05:33:09.946222+0000 mgr.y (mgr.25142) 425 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:33:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:11 smithi089 bash[88398]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:11 smithi089 bash[88398]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:11 smithi089 bash[91918]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:11 smithi089 bash[91918]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:11 smithi110 bash[70834]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:11 smithi110 bash[70834]: cluster 2024-09-21T05:33:10.803480+0000 mgr.y (mgr.25142) 426 : cluster [DBG] pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:13.046628202Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[91918]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:14.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:13 smithi089 bash[88398]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.626049+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.629234+0000 mgr.y (mgr.25142) 427 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.629316+0000 mgr.y (mgr.25142) 428 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.632489+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.635845+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.636566+0000 mgr.y (mgr.25142) 429 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.641189+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.649353+0000 mon.b (mon.1) 87 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.649746+0000 mgr.y (mgr.25142) 430 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.654707+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.662558+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.663326+0000 mgr.y (mgr.25142) 431 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:33:14.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.668184+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.676517+0000 mgr.y (mgr.25142) 432 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: audit 2024-09-21T05:33:12.677012+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:14.057 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:13 smithi110 bash[70834]: cephadm 2024-09-21T05:33:12.678909+0000 mgr.y (mgr.25142) 433 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-09-21T05:33:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:14 smithi089 bash[88398]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:14 smithi089 bash[88398]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:15.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:14 smithi089 bash[91918]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:15.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:14 smithi089 bash[91918]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:14 smithi110 bash[70834]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:14 smithi110 bash[70834]: cluster 2024-09-21T05:33:12.804279+0000 mgr.y (mgr.25142) 434 : cluster [DBG] pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:16.039328335Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:16 smithi110 bash[70834]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:16] "GET /metrics HTTP/1.1" 200 38228 "" "Prometheus/2.51.0" 2024-09-21T05:33:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[88398]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cluster 2024-09-21T05:33:14.805019+0000 mgr.y (mgr.25142) 435 : cluster [DBG] pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:16.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cephadm 2024-09-21T05:33:15.279174+0000 mgr.y (mgr.25142) 436 : cephadm [INF] Upgrade: Updating osd.0 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.286945+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.292693+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: audit 2024-09-21T05:33:15.294237+0000 mon.b (mon.1) 91 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.549 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:16 smithi089 bash[91918]: cephadm 2024-09-21T05:33:15.298793+0000 mgr.y (mgr.25142) 437 : cephadm [INF] Deploying daemon osd.0 on smithi089 2024-09-21T05:33:16.782 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:33:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:18 smithi089 bash[88398]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:18 smithi089 bash[88398]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:18 smithi089 bash[91918]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:18 smithi089 bash[91918]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:18 smithi110 bash[70834]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:18 smithi110 bash[70834]: cluster 2024-09-21T05:33:16.805929+0000 mgr.y (mgr.25142) 438 : cluster [DBG] pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:18.901 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:33:19.538 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:33:19.538 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (5m) 91s ago 32m 13.8M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:33:19.538 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (5m) 3m ago 32m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (7m) 91s ago 30m 48.9M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (7m) 3m ago 41m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (18m) 91s ago 43m 512M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (2m) 91s ago 43m 39.9M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (3m) 3m ago 41m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (99s) 91s ago 41m 18.7M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (6m) 91s ago 33m 8500k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (6m) 3m ago 32m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (40m) 91s ago 40m 58.8M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 297e9f73ab54 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (39m) 91s ago 39m 68.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (38m) 91s ago 38m 64.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (37m) 91s ago 37m 59.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (36m) 3m ago 36m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:33:19.539 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (35m) 3m ago 35m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:33:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (35m) 3m ago 35m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:33:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (34m) 3m ago 34m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:33:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (6m) 3m ago 33m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:33:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (30m) 91s ago 30m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:33:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (30m) 3m ago 30m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:33:19.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:19.060752446Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:19 smithi110 bash[70834]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:19 smithi110 bash[70834]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:19 smithi089 bash[88398]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:19 smithi089 bash[88398]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.685 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:19 smithi089 bash[91918]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.685 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:19 smithi089 bash[91918]: audit 2024-09-21T05:33:18.385576+0000 mgr.y (mgr.25142) 439 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:33:19.914 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 5 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:33:19.915 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (2 remaining).", 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/8 daemons upgraded", 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:33:20.206 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:33:20.753 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[88398]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:20.754 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:20.755 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 bash[91918]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: cluster 2024-09-21T05:33:18.806673+0000 mgr.y (mgr.25142) 440 : cluster [DBG] pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:18.888051+0000 mgr.y (mgr.25142) 441 : audit [DBG] from='client.44178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.210164+0000 mgr.y (mgr.25142) 442 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.516670+0000 mgr.y (mgr.25142) 443 : audit [DBG] from='client.54164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:20.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:20.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:20 smithi110 bash[70834]: audit 2024-09-21T05:33:19.914754+0000 mon.a (mon.0) 118 : audit [DBG] from='client.? 172.21.15.89:0/290482470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:21.039 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.039 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.040 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.040 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.040 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.041 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.041 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.041 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.042 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:21 smithi089 systemd[1]: Stopping Ceph osd.0 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:33:21.042 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:20 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:21.296 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[29494]: debug 2024-09-21T05:33:21.150+0000 7f644171a640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:33:21.297 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[29494]: debug 2024-09-21T05:33:21.150+0000 7f644171a640 -1 osd.0 112 *** Got signal Terminated *** 2024-09-21T05:33:21.297 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[29494]: debug 2024-09-21T05:33:21.150+0000 7f644171a640 -1 osd.0 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:33:21.740 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.741 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:21.742 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:21 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: audit 2024-09-21T05:33:20.205556+0000 mgr.y (mgr.25142) 444 : audit [DBG] from='client.54176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: audit 2024-09-21T05:33:20.459995+0000 mon.b (mon.1) 92 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:21 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.156593+0000 mon.a (mon.0) 119 : cluster [INF] osd.0 marked itself down and dead 2024-09-21T05:33:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:22.04188394Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:22.684 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[97117]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-0 2024-09-21T05:33:22.684 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[97179]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-0 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[88398]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.685 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:22.686 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:22 smithi089 bash[91918]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:20.808267+0000 mgr.y (mgr.25142) 445 : cluster [DBG] pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.361395+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:22 smithi110 bash[70834]: cluster 2024-09-21T05:33:21.381222+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e113: 8 total, 7 up, 8 in 2024-09-21T05:33:23.697 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:23 smithi089 bash[88398]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:23.697 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:23 smithi089 bash[88398]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:23.697 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:23 smithi089 bash[91918]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:23.697 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:23 smithi089 bash[91918]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:23 smithi110 bash[70834]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:23 smithi110 bash[70834]: cluster 2024-09-21T05:33:22.383273+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e114: 8 total, 7 up, 8 in 2024-09-21T05:33:24.652 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:24 smithi089 bash[88398]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.652 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:24 smithi089 bash[88398]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.652 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:24 smithi089 bash[91918]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.652 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:24 smithi089 bash[91918]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:24 smithi110 bash[70834]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:24 smithi110 bash[70834]: cluster 2024-09-21T05:33:22.808980+0000 mgr.y (mgr.25142) 446 : cluster [DBG] pgmap v239: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:24.947 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.947 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.947 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.948 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.948 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.948 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.948 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.949 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.949 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T05:33:24.949 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: Stopped Ceph osd.0 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:33:24.949 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:33:24.949 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:24 smithi089 systemd[1]: Started Ceph osd.0 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:33:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:25.054899352Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:26] "GET /metrics HTTP/1.1" 200 38227 "" "Prometheus/2.51.0" 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[91918]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:25 smithi089 bash[88398]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: cluster 2024-09-21T05:33:24.809424+0000 mgr.y (mgr.25142) 447 : cluster [DBG] pgmap v240: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:33:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:24.994283+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.006473+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.017635+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.572819+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:25 smithi110 bash[70834]: audit 2024-09-21T05:33:25.581639+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:26.796 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:26 smithi089 bash[97326]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:33:26.797 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:26 smithi089 bash[97326]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:33:27.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:27 smithi110 bash[70834]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:27.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:27 smithi110 bash[70834]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:27.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:27 smithi089 bash[88398]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:27.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:27 smithi089 bash[88398]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:27.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:27 smithi089 bash[91918]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:27.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:27 smithi089 bash[91918]: cluster 2024-09-21T05:33:26.994458+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: Degraded data redundancy: 74/732 objects degraded (10.109%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:28.032494104Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:28 smithi110 bash[70834]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:28 smithi110 bash[70834]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:28.396 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:28 smithi089 bash[88398]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:28.396 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:28 smithi089 bash[88398]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:28.396 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:28 smithi089 bash[91918]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:28.396 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:28 smithi089 bash[91918]: cluster 2024-09-21T05:33:26.811344+0000 mgr.y (mgr.25142) 448 : cluster [DBG] pgmap v241: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:29.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:29 smithi089 bash[88398]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:29.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:29 smithi089 bash[88398]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:29.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:29 smithi089 bash[91918]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:29.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:29 smithi089 bash[91918]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:29.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:29 smithi110 bash[70834]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:29.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:29 smithi110 bash[70834]: audit 2024-09-21T05:33:28.395565+0000 mgr.y (mgr.25142) 449 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:30.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[88398]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:30.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[88398]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[91918]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[91918]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:30.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:33:30.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:33:30.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:33:30.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T05:33:30.547 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T05:33:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:30 smithi110 bash[70834]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:30 smithi110 bash[70834]: cluster 2024-09-21T05:33:28.812310+0000 mgr.y (mgr.25142) 450 : cluster [DBG] pgmap v242: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 74/732 objects degraded (10.109%) 2024-09-21T05:33:31.046 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T05:33:31.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T05:33:31.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T05:33:31.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T05:33:31.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:30 smithi089 bash[97326]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T05:33:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:31.023565107Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[91918]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:31 smithi089 bash[88398]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: cluster 2024-09-21T05:33:30.813192+0000 mgr.y (mgr.25142) 451 : cluster [DBG] pgmap v243: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 433 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: audit 2024-09-21T05:33:30.872483+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:31 smithi110 bash[70834]: audit 2024-09-21T05:33:30.886109+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:32.987 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[98020]: debug 2024-09-21T05:33:32.686+0000 7f12a3b5a640 1 -- 172.21.15.89:0/2044408743 <== mon.2 v2:172.21.15.89:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562330726960 con 0x562331516000 2024-09-21T05:33:33.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[88398]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[88398]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[88398]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[88398]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[91918]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[91918]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[91918]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:32 smithi089 bash[91918]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:32 smithi110 bash[70834]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:32 smithi110 bash[70834]: audit 2024-09-21T05:33:31.989423+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:32 smithi110 bash[70834]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:33.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:32 smithi110 bash[70834]: audit 2024-09-21T05:33:32.003178+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:34.296 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:34 smithi089 bash[98020]: debug 2024-09-21T05:33:34.214+0000 7f12a63c1640 -1 Falling back to public interface 2024-09-21T05:33:34.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:34 smithi089 bash[91918]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:34.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:34 smithi089 bash[91918]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:34.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:34 smithi089 bash[88398]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:34.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:34 smithi089 bash[88398]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:34.031843157Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:34 smithi110 bash[70834]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:34 smithi110 bash[70834]: cluster 2024-09-21T05:33:32.814147+0000 mgr.y (mgr.25142) 452 : cluster [DBG] pgmap v244: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 392 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.464 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:36] "GET /metrics HTTP/1.1" 200 38360 "" "Prometheus/2.51.0" 2024-09-21T05:33:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[88398]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:36 smithi089 bash[91918]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: cluster 2024-09-21T05:33:34.814787+0000 mgr.y (mgr.25142) 453 : cluster [DBG] pgmap v245: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: audit 2024-09-21T05:33:35.465690+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:36 smithi110 bash[70834]: audit 2024-09-21T05:33:35.469644+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:37.02202475Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:38.046 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:37 smithi089 bash[98020]: debug 2024-09-21T05:33:37.630+0000 7f12a63c1640 -1 osd.0 112 log_to_monitors true 2024-09-21T05:33:38.692 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[98020]: debug 2024-09-21T05:33:38.506+0000 7f129e16b640 -1 osd.0 112 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:33:38.692 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[88398]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.692 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[88398]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.692 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[88398]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:38.692 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[88398]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:38.693 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[91918]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.693 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[91918]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.693 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[91918]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:38.693 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:38 smithi089 bash[91918]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:38 smithi110 bash[70834]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:38 smithi110 bash[70834]: cluster 2024-09-21T05:33:36.816620+0000 mgr.y (mgr.25142) 454 : cluster [DBG] pgmap v246: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 276 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:38 smithi110 bash[70834]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:38 smithi110 bash[70834]: audit 2024-09-21T05:33:37.639980+0000 mon.a (mon.0) 134 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[88398]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:39 smithi089 bash[91918]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.406038+0000 mgr.y (mgr.25142) 455 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.476060+0000 mon.a (mon.0) 135 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: cluster 2024-09-21T05:33:38.479171+0000 mon.a (mon.0) 136 : cluster [DBG] osdmap e115: 8 total, 7 up, 8 in 2024-09-21T05:33:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:39.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:39 smithi110 bash[70834]: audit 2024-09-21T05:33:38.479623+0000 mon.a (mon.0) 137 : audit [INF] from='osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:33:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:40.04767545Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[88398]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:40 smithi089 bash[91918]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:38.817588+0000 mgr.y (mgr.25142) 456 : cluster [DBG] pgmap v248: 161 pgs: 38 active+undersized, 20 active+undersized+degraded, 103 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 74/732 objects degraded (10.109%) 2024-09-21T05:33:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.477131+0000 mon.a (mon.0) 138 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:33:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: audit 2024-09-21T05:33:39.487045+0000 mon.b (mon.1) 94 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.487606+0000 mon.a (mon.0) 139 : cluster [INF] osd.0 [v2:172.21.15.89:6802/3620747441,v1:172.21.15.89:6803/3620747441] boot 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:39.487744+0000 mon.a (mon.0) 140 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:40.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:40 smithi110 bash[70834]: cluster 2024-09-21T05:33:40.491002+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-09-21T05:33:41.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:41 smithi089 bash[88398]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:41.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:41 smithi089 bash[88398]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:41.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:41 smithi089 bash[91918]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:41.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:41 smithi089 bash[91918]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:41 smithi110 bash[70834]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:41 smithi110 bash[70834]: cluster 2024-09-21T05:33:41.506533+0000 mon.a (mon.0) 142 : cluster [WRN] Health check update: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:42 smithi110 bash[70834]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[68019]: debug 2024-09-21T05:33:42.565+0000 7f1a88244640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[88398]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: cluster 2024-09-21T05:33:40.818565+0000 mgr.y (mgr.25142) 457 : cluster [DBG] pgmap v251: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.424108+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.437263+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.441923+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.443835+0000 mon.b (mon.1) 96 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.453380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.551959+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.555616+0000 mon.b (mon.1) 98 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:42 smithi089 bash[91918]: audit 2024-09-21T05:33:42.558329+0000 mon.b (mon.1) 99 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:43.027930741Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[88398]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:43 smithi089 bash[91918]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.560656+0000 mon.b (mon.1) 100 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.571941+0000 mgr.y (mgr.25142) 458 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: audit 2024-09-21T05:33:42.572479+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:43 smithi110 bash[70834]: cephadm 2024-09-21T05:33:42.573870+0000 mgr.y (mgr.25142) 459 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-09-21T05:33:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:44 smithi089 bash[88398]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:44 smithi089 bash[88398]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:44 smithi089 bash[91918]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:44 smithi089 bash[91918]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:44 smithi110 bash[70834]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:44 smithi110 bash[70834]: cluster 2024-09-21T05:33:42.819332+0000 mgr.y (mgr.25142) 460 : cluster [DBG] pgmap v252: 161 pgs: 14 active+undersized, 7 active+undersized+degraded, 140 active+clean; 585 KiB data, 272 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:33:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[88398]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[88398]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[88398]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[88398]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[91918]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[91918]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[91918]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:45 smithi089 bash[91918]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:45 smithi110 bash[70834]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:45 smithi110 bash[70834]: cluster 2024-09-21T05:33:45.571903+0000 mon.a (mon.0) 146 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 7 pgs degraded) 2024-09-21T05:33:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:45 smithi110 bash[70834]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:45 smithi110 bash[70834]: cluster 2024-09-21T05:33:45.571944+0000 mon.a (mon.0) 147 : cluster [INF] Cluster is now healthy 2024-09-21T05:33:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:46] "GET /metrics HTTP/1.1" 200 38360 "" "Prometheus/2.51.0" 2024-09-21T05:33:46.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:46.061821151Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:46 smithi089 bash[88398]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:46 smithi089 bash[88398]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:46 smithi089 bash[91918]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:46 smithi089 bash[91918]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:46 smithi110 bash[70834]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:46 smithi110 bash[70834]: cluster 2024-09-21T05:33:44.820231+0000 mgr.y (mgr.25142) 461 : cluster [DBG] pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 273 MiB used, 715 GiB / 715 GiB avail; 807 B/s rd, 0 op/s 2024-09-21T05:33:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:48 smithi089 bash[88398]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:48 smithi089 bash[88398]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:48 smithi089 bash[91918]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:48 smithi089 bash[91918]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:48 smithi110 bash[70834]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:48 smithi110 bash[70834]: cluster 2024-09-21T05:33:46.821842+0000 mgr.y (mgr.25142) 462 : cluster [DBG] pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:49.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:49.055181789Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:49 smithi089 bash[88398]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:49 smithi089 bash[88398]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:49 smithi089 bash[91918]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:49 smithi089 bash[91918]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:49 smithi110 bash[70834]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:49 smithi110 bash[70834]: audit 2024-09-21T05:33:48.410174+0000 mgr.y (mgr.25142) 463 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:33:50.551 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:33:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[88398]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:50 smithi089 bash[91918]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: cluster 2024-09-21T05:33:48.822683+0000 mgr.y (mgr.25142) 464 : cluster [DBG] pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:33:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.466514+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.470236+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:33:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:50 smithi110 bash[70834]: audit 2024-09-21T05:33:50.596528+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (6m) 20s ago 33m 13.8M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (5m) 3m ago 33m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (8m) 20s ago 30m 48.9M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (7m) 3m ago 41m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:33:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (18m) 20s ago 43m 514M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (2m) 20s ago 44m 43.7M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (3m) 3m ago 42m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (2m) 20s ago 42m 32.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (7m) 20s ago 33m 8311k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (7m) 3m ago 33m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running 20s ago 41m - 3036M 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (40m) 20s ago 40m 70.5M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 89282376d93b 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (39m) 20s ago 39m 65.2M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (38m) 20s ago 38m 60.7M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (37m) 3m ago 37m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (36m) 3m ago 36m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (35m) 3m ago 35m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (34m) 3m ago 34m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:33:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (6m) 3m ago 33m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:33:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (31m) 20s ago 31m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:33:51.208 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (31m) 3m ago 31m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:33:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 9, 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 6 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:33:51.588 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:33:51.893 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:33:51.893 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (1 remaining).", 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/8 daemons upgraded", 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:33:51.894 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:33:52.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:51 smithi110 bash[70834]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:51 smithi110 bash[70834]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:51 smithi110 bash[70834]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:51 smithi110 bash[70834]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[88398]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[88398]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[88398]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[88398]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[91918]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[91918]: audit 2024-09-21T05:33:50.538712+0000 mgr.y (mgr.25142) 465 : audit [DBG] from='client.54188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[91918]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:51 smithi089 bash[91918]: audit 2024-09-21T05:33:51.587037+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.89:0/3354588440' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:33:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:52.04490158Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:53.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[88398]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:52 smithi089 bash[91918]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: cluster 2024-09-21T05:33:50.824186+0000 mgr.y (mgr.25142) 466 : cluster [DBG] pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: audit 2024-09-21T05:33:50.853883+0000 mgr.y (mgr.25142) 467 : audit [DBG] from='client.54194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:53.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:52 smithi110 bash[70834]: audit 2024-09-21T05:33:51.167513+0000 mgr.y (mgr.25142) 468 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:53 smithi089 bash[88398]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:53 smithi089 bash[88398]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:53 smithi089 bash[91918]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:53 smithi089 bash[91918]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:53 smithi110 bash[70834]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:53 smithi110 bash[70834]: audit 2024-09-21T05:33:51.893386+0000 mgr.y (mgr.25142) 469 : audit [DBG] from='client.54212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:33:55.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:54 smithi110 bash[70834]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:54 smithi110 bash[70834]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:54 smithi089 bash[88398]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:54 smithi089 bash[88398]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:54 smithi089 bash[91918]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:54 smithi089 bash[91918]: cluster 2024-09-21T05:33:52.824873+0000 mgr.y (mgr.25142) 470 : cluster [DBG] pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:55.041474738Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:56.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:33:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:33:56] "GET /metrics HTTP/1.1" 200 38357 "" "Prometheus/2.51.0" 2024-09-21T05:33:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:56 smithi089 bash[88398]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:56 smithi089 bash[88398]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:56 smithi089 bash[91918]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:56 smithi089 bash[91918]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:56 smithi110 bash[70834]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:56 smithi110 bash[70834]: cluster 2024-09-21T05:33:54.825795+0000 mgr.y (mgr.25142) 471 : cluster [DBG] pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:33:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:57 smithi110 bash[70834]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:57 smithi110 bash[70834]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:57 smithi089 bash[91918]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:57 smithi089 bash[91918]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:57 smithi089 bash[88398]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:57 smithi089 bash[88398]: audit 2024-09-21T05:33:57.577763+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T05:33:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:33:58.043891084Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:33:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:33:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[88398]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:33:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:33:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:58 smithi089 bash[91918]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:33:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: cluster 2024-09-21T05:33:56.827396+0000 mgr.y (mgr.25142) 472 : cluster [DBG] pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:33:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: audit 2024-09-21T05:33:57.577470+0000 mgr.y (mgr.25142) 473 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T05:33:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:33:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:58 smithi110 bash[70834]: cephadm 2024-09-21T05:33:57.580779+0000 mgr.y (mgr.25142) 474 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-09-21T05:34:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:59 smithi089 bash[88398]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:33:59 smithi089 bash[88398]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:59 smithi089 bash[91918]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:33:59 smithi089 bash[91918]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:59 smithi110 bash[70834]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:33:59 smithi110 bash[70834]: audit 2024-09-21T05:33:58.421439+0000 mgr.y (mgr.25142) 475 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[88398]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:00.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:00 smithi089 bash[91918]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: cluster 2024-09-21T05:33:58.828289+0000 mgr.y (mgr.25142) 476 : cluster [DBG] pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.930736+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.936681+0000 mon.b (mon.1) 104 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:01.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:00 smithi110 bash[70834]: audit 2024-09-21T05:33:59.938406+0000 mon.b (mon.1) 105 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:01.05013598Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:02.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[88398]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[88398]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[88398]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[88398]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[91918]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[91918]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[91918]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:02.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:01 smithi089 bash[91918]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:01 smithi110 bash[70834]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:01 smithi110 bash[70834]: cephadm 2024-09-21T05:33:59.920676+0000 mgr.y (mgr.25142) 477 : cephadm [INF] Upgrade: Updating osd.1 2024-09-21T05:34:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:01 smithi110 bash[70834]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:02.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:01 smithi110 bash[70834]: cephadm 2024-09-21T05:33:59.943194+0000 mgr.y (mgr.25142) 478 : cephadm [INF] Deploying daemon osd.1 on smithi089 2024-09-21T05:34:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:02 smithi089 bash[88398]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:02 smithi089 bash[88398]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:02 smithi089 bash[91918]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:02 smithi089 bash[91918]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:02 smithi110 bash[70834]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:02 smithi110 bash[70834]: cluster 2024-09-21T05:34:00.829977+0000 mgr.y (mgr.25142) 479 : cluster [DBG] pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:04.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:04.057952876Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:04.992 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:04 smithi089 bash[88398]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:04.992 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:04 smithi089 bash[88398]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:04.992 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:04 smithi089 bash[91918]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:04.992 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:04 smithi089 bash[91918]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:04 smithi110 bash[70834]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:04 smithi110 bash[70834]: cluster 2024-09-21T05:34:02.830694+0000 mgr.y (mgr.25142) 480 : cluster [DBG] pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:05.297 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:34:04 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.298 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:34:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.298 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:04 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:05 smithi089 systemd[1]: Stopping Ceph osd.1 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[34752]: debug 2024-09-21T05:34:05.225+0000 7f994c556640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[34752]: debug 2024-09-21T05:34:05.225+0000 7f994c556640 -1 osd.1 117 *** Got signal Terminated *** 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[34752]: debug 2024-09-21T05:34:05.225+0000 7f994c556640 -1 osd.1 117 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:34:04 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.299 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:34:04 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:34:04 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:05.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:05 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:06.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[91918]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[91918]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[88398]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:05 smithi089 bash[88398]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:05 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:05 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.226067+0000 mon.a (mon.0) 152 : cluster [INF] osd.1 marked itself down and dead 2024-09-21T05:34:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:05 smithi110 bash[70834]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:05 smithi110 bash[70834]: audit 2024-09-21T05:34:05.461286+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:06] "GET /metrics HTTP/1.1" 200 38357 "" "Prometheus/2.51.0" 2024-09-21T05:34:07.037 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[101439]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-1 2024-09-21T05:34:07.037 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.037 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.037 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[88398]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.038 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:06 smithi089 bash[91918]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:04.831587+0000 mgr.y (mgr.25142) 481 : cluster [DBG] pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:07.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.712768+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:34:07.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:06 smithi110 bash[70834]: cluster 2024-09-21T05:34:05.729045+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e118: 8 total, 7 up, 8 in 2024-09-21T05:34:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:07.048803059Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:07.546 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[101504]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-1 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[88398]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[88398]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[88398]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[88398]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[91918]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[91918]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[91918]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:08.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:07 smithi089 bash[91918]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:07 smithi110 bash[70834]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:07 smithi110 bash[70834]: cluster 2024-09-21T05:34:06.734931+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e119: 8 total, 7 up, 8 in 2024-09-21T05:34:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:07 smithi110 bash[70834]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:07 smithi110 bash[70834]: cluster 2024-09-21T05:34:06.832312+0000 mgr.y (mgr.25142) 482 : cluster [DBG] pgmap v266: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:08 smithi089 bash[88398]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:08 smithi089 bash[88398]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:08 smithi089 bash[91918]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:08 smithi089 bash[91918]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:08 smithi110 bash[70834]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:08 smithi110 bash[70834]: audit 2024-09-21T05:34:08.432514+0000 mgr.y (mgr.25142) 483 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:09.382 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.382 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.383 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.383 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.383 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: Stopped Ceph osd.1 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:09.384 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: Started Ceph osd.1 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:34:09.385 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:34:09 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:34:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:10.025200657Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.747 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[88398]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.748 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:10.749 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[91918]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: cluster 2024-09-21T05:34:08.833279+0000 mgr.y (mgr.25142) 484 : cluster [DBG] pgmap v267: 161 pgs: 6 active+undersized, 20 stale+active+clean, 1 active+undersized+degraded, 134 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 6/732 objects degraded (0.820%) 2024-09-21T05:34:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.429421+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.449905+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: audit 2024-09-21T05:34:09.467335+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:10 smithi110 bash[70834]: cluster 2024-09-21T05:34:09.740508+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 6/732 objects degraded (0.820%), 1 pg degraded (PG_DEGRADED) 2024-09-21T05:34:11.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[101650]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:34:11.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:10 smithi089 bash[101650]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:34:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:12 smithi089 bash[91918]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:12 smithi089 bash[91918]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:12 smithi089 bash[88398]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:12.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:12 smithi089 bash[88398]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:12 smithi110 bash[70834]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:12.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:12 smithi110 bash[70834]: cluster 2024-09-21T05:34:10.834213+0000 mgr.y (mgr.25142) 485 : cluster [DBG] pgmap v268: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:13.030639735Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:14.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[88398]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:14.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[88398]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[91918]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:14.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[91918]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:14.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:34:14.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:34:14.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:34:14.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T05:34:14.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T05:34:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:14 smithi110 bash[70834]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:14.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:14 smithi110 bash[70834]: cluster 2024-09-21T05:34:12.835133+0000 mgr.y (mgr.25142) 486 : cluster [DBG] pgmap v269: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:15.296 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T05:34:15.296 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T05:34:15.296 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T05:34:15.296 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T05:34:15.296 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:14 smithi089 bash[101650]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T05:34:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:16.022819626Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:16] "GET /metrics HTTP/1.1" 200 38357 "" "Prometheus/2.51.0" 2024-09-21T05:34:16.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[91918]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[88398]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: cluster 2024-09-21T05:34:14.835741+0000 mgr.y (mgr.25142) 487 : cluster [DBG] pgmap v270: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: audit 2024-09-21T05:34:15.349948+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:16.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:16 smithi110 bash[70834]: audit 2024-09-21T05:34:15.361507+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:16 smithi089 bash[102341]: debug 2024-09-21T05:34:16.853+0000 7f619ad75640 1 -- 172.21.15.89:0/3339521444 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558708170960 con 0x558708191c00 2024-09-21T05:34:17.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[88398]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[88398]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[88398]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[88398]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[91918]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[91918]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[91918]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:17 smithi089 bash[91918]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:17 smithi110 bash[70834]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:17 smithi110 bash[70834]: audit 2024-09-21T05:34:16.408516+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:17 smithi110 bash[70834]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:17.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:17 smithi110 bash[70834]: audit 2024-09-21T05:34:16.419132+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:18.796 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:18 smithi089 bash[102341]: debug 2024-09-21T05:34:18.389+0000 7f619d5dc640 -1 Falling back to public interface 2024-09-21T05:34:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:18 smithi089 bash[88398]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:18.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:18 smithi089 bash[88398]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:18 smithi089 bash[91918]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:18 smithi089 bash[91918]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:18 smithi110 bash[70834]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:18 smithi110 bash[70834]: cluster 2024-09-21T05:34:16.836532+0000 mgr.y (mgr.25142) 488 : cluster [DBG] pgmap v271: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:19.052041549Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:19.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[88398]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[88398]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[88398]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[88398]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[91918]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[91918]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[91918]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:19.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:19 smithi089 bash[91918]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:19 smithi110 bash[70834]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:19 smithi110 bash[70834]: audit 2024-09-21T05:34:18.442111+0000 mgr.y (mgr.25142) 489 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:19 smithi110 bash[70834]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:19.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:19 smithi110 bash[70834]: cluster 2024-09-21T05:34:19.369927+0000 mon.a (mon.0) 164 : cluster [WRN] Health check update: Degraded data redundancy: 102/732 objects degraded (13.934%), 23 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:20 smithi089 bash[88398]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:20 smithi089 bash[88398]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:20 smithi089 bash[91918]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:20 smithi089 bash[91918]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:20 smithi110 bash[70834]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:20 smithi110 bash[70834]: cluster 2024-09-21T05:34:18.837664+0000 mgr.y (mgr.25142) 490 : cluster [DBG] pgmap v272: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[88398]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[88398]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[88398]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:21.793 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[88398]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:21.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[91918]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[91918]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[91918]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:21.794 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[91918]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:21 smithi110 bash[70834]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:21 smithi110 bash[70834]: audit 2024-09-21T05:34:20.465708+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:21 smithi110 bash[70834]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:21 smithi110 bash[70834]: audit 2024-09-21T05:34:20.470857+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:22.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:21 smithi089 bash[102341]: debug 2024-09-21T05:34:21.793+0000 7f619d5dc640 -1 osd.1 117 log_to_monitors true 2024-09-21T05:34:22.240 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:34:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:22.025009211Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:22.745 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.745 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.745 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[88398]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[102341]: debug 2024-09-21T05:34:22.525+0000 7f619137e640 -1 osd.1 117 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.746 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.747 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.747 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:22 smithi089 bash[91918]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: cluster 2024-09-21T05:34:20.839392+0000 mgr.y (mgr.25142) 491 : cluster [DBG] pgmap v273: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 277 MiB used, 715 GiB / 715 GiB avail; 102/732 objects degraded (13.934%) 2024-09-21T05:34:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: audit 2024-09-21T05:34:21.798039+0000 mon.c (mon.2) 4 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:22 smithi110 bash[70834]: audit 2024-09-21T05:34:21.798411+0000 mon.a (mon.0) 166 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (6m) 7s ago 33m 13.9M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (6m) 4m ago 33m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (8m) 7s ago 31m 49.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (8m) 4m ago 42m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (19m) 7s ago 44m 517M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (3m) 7s ago 44m 49.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (4m) 4m ago 42m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (2m) 7s ago 42m 34.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (7m) 7s ago 34m 8628k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (7m) 4m ago 34m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:34:22.902 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (51s) 7s ago 41m 45.7M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running 7s ago 40m - 3036M 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (39m) 7s ago 39m 65.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (38m) 7s ago 38m 62.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (37m) 4m ago 37m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (36m) 4m ago 37m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (36m) 4m ago 36m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (35m) 4m ago 35m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (7m) 4m ago 34m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (31m) 7s ago 31m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:34:22.903 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (31m) 4m ago 31m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:34:23.269 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 1 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:34:23.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:34:23.271 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:34:23.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T05:34:23.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 6 2024-09-21T05:34:23.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:34:23.271 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (0 remaining).", 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/8 daemons upgraded", 2024-09-21T05:34:23.602 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:34:23.603 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:34:23.603 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[88398]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:23 smithi089 bash[91918]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.226859+0000 mgr.y (mgr.25142) 492 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.474510+0000 mon.a (mon.0) 167 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T05:34:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: cluster 2024-09-21T05:34:22.482061+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e120: 8 total, 7 up, 8 in 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.482151+0000 mon.c (mon.2) 5 : audit [INF] from='osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.483308+0000 mon.a (mon.0) 169 : audit [INF] from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:22.563591+0000 mgr.y (mgr.25142) 493 : audit [DBG] from='client.54230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:23.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:23 smithi110 bash[70834]: audit 2024-09-21T05:34:23.269895+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.89:0/3514994912' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[88398]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:24 smithi089 bash[91918]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:22.839937+0000 mgr.y (mgr.25142) 494 : cluster [DBG] pgmap v275: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:22.888903+0000 mgr.y (mgr.25142) 495 : audit [DBG] from='client.54236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.485989+0000 mon.a (mon.0) 170 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:23.502350+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.509026+0000 mon.a (mon.0) 171 : cluster [INF] osd.1 [v2:172.21.15.89:6810/3015124266,v1:172.21.15.89:6811/3015124266] boot 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: cluster 2024-09-21T05:34:23.509182+0000 mon.a (mon.0) 172 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:24 smithi110 bash[70834]: audit 2024-09-21T05:34:23.602603+0000 mgr.y (mgr.25142) 496 : audit [DBG] from='client.54248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:25.043143386Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:25 smithi089 bash[88398]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:25 smithi089 bash[88398]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:25.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:25 smithi089 bash[91918]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:25.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:25 smithi089 bash[91918]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:25 smithi110 bash[70834]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:25 smithi110 bash[70834]: cluster 2024-09-21T05:34:24.513213+0000 mon.a (mon.0) 173 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-09-21T05:34:26.515 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:26] "GET /metrics HTTP/1.1" 200 38296 "" "Prometheus/2.51.0" 2024-09-21T05:34:26.517 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.517 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.518 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[88398]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: cluster 2024-09-21T05:34:24.840619+0000 mgr.y (mgr.25142) 497 : cluster [DBG] pgmap v278: 161 pgs: 40 active+undersized, 23 active+undersized+degraded, 98 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 102/732 objects degraded (13.934%) 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.466442+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.480262+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.484634+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.487164+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:26.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:26 smithi089 bash[91918]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:26 smithi110 bash[70834]: audit 2024-09-21T05:34:26.498110+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.802 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.803 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.804 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.805 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.806 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.807 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.808 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.809 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.810 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.811 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.812 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.814 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.815 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.816 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.817 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[88398]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.818 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.819 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:27 smithi089 bash[91918]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.820 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.580058+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.583705+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.587858+0000 mon.b (mon.1) 113 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.588673+0000 mgr.y (mgr.25142) 498 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.596259+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.603073+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.605929+0000 mon.b (mon.1) 115 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.821 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.608867+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.611927+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.614768+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.617690+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.618564+0000 mgr.y (mgr.25142) 499 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.622731+0000 mon.b (mon.1) 120 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.622762+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.822 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.628653+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.633983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.634001+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.640031+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.644771+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.644855+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.650625+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:34:27.823 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.655917+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.655920+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.658875+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.658920+0000 mon.b (mon.1) 124 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.661807+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.661873+0000 mon.b (mon.1) 125 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.664444+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.824 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.664453+0000 mon.b (mon.1) 126 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.667098+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.667171+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.669924+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.669962+0000 mon.b (mon.1) 128 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.672662+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.672674+0000 mon.b (mon.1) 129 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:34:27.825 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.675473+0000 mon.b (mon.1) 130 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.675490+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.678516+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.678531+0000 mon.b (mon.1) 131 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.684448+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.689626+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.826 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.689628+0000 mon.b (mon.1) 132 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.692817+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.692834+0000 mon.b (mon.1) 133 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.695884+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.695913+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.698851+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.698860+0000 mon.b (mon.1) 135 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.827 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.701985+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.702033+0000 mon.b (mon.1) 136 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.705117+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.705133+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: cephadm 2024-09-21T05:34:26.706964+0000 mgr.y (mgr.25142) 500 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.708699+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.828 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.708720+0000 mon.b (mon.1) 138 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.714641+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.718059+0000 mon.b (mon.1) 139 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.720150+0000 mon.b (mon.1) 140 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.732853+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.855019+0000 mon.b (mon.1) 141 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:34:27.829 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.830 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.857141+0000 mon.b (mon.1) 142 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:34:27.830 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:27.830 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:27 smithi110 bash[70834]: audit 2024-09-21T05:34:26.865695+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:28.052761128Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[88398]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[88398]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[88398]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[88398]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[91918]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[91918]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[91918]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:28 smithi089 bash[91918]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:28 smithi110 bash[70834]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:28 smithi110 bash[70834]: cluster 2024-09-21T05:34:26.841857+0000 mgr.y (mgr.25142) 501 : cluster [DBG] pgmap v279: 161 pgs: 20 active+undersized, 7 active+undersized+degraded, 134 active+clean; 585 KiB data, 269 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 43/732 objects degraded (5.874%) 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:28 smithi110 bash[70834]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:28 smithi110 bash[70834]: cluster 2024-09-21T05:34:27.726389+0000 mon.a (mon.0) 204 : cluster [WRN] Health check update: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T05:34:29.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:29 smithi089 bash[88398]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:29.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:29 smithi089 bash[88398]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:29 smithi089 bash[91918]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:29.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:29 smithi089 bash[91918]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:29 smithi110 bash[70834]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:29.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:29 smithi110 bash[70834]: audit 2024-09-21T05:34:28.453072+0000 mgr.y (mgr.25142) 502 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[88398]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:30.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:30 smithi089 bash[91918]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:28.842899+0000 mgr.y (mgr.25142) 503 : cluster [DBG] pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:29.521174+0000 mon.a (mon.0) 205 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/732 objects degraded (5.874%), 7 pgs degraded) 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:30 smithi110 bash[70834]: cluster 2024-09-21T05:34:29.521217+0000 mon.a (mon.0) 206 : cluster [INF] Cluster is now healthy 2024-09-21T05:34:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:31.052944176Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:31 smithi089 bash[88398]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:31 smithi089 bash[88398]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:31 smithi089 bash[91918]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:31 smithi089 bash[91918]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:31 smithi110 bash[70834]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:31 smithi110 bash[70834]: audit 2024-09-21T05:34:30.623548+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:32 smithi089 bash[88398]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:33.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:32 smithi089 bash[88398]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:32 smithi089 bash[91918]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:32 smithi089 bash[91918]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:32 smithi110 bash[70834]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:32 smithi110 bash[70834]: cluster 2024-09-21T05:34:30.844324+0000 mgr.y (mgr.25142) 504 : cluster [DBG] pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:34.050144135Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:34 smithi089 bash[88398]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:35.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:34 smithi089 bash[88398]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:34 smithi089 bash[91918]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:34 smithi089 bash[91918]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:34 smithi110 bash[70834]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:34 smithi110 bash[70834]: cluster 2024-09-21T05:34:32.845297+0000 mgr.y (mgr.25142) 505 : cluster [DBG] pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:34:36.466 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:36] "GET /metrics HTTP/1.1" 200 38353 "" "Prometheus/2.51.0" 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[88398]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:36 smithi089 bash[91918]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: cluster 2024-09-21T05:34:34.846231+0000 mgr.y (mgr.25142) 506 : cluster [DBG] pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 990 B/s rd, 0 op/s 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.468248+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.471810+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:36.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:36.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:36 smithi110 bash[70834]: audit 2024-09-21T05:34:35.636958+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:34:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:37.048503313Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:38 smithi089 bash[88398]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:38.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:38 smithi089 bash[88398]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:38 smithi089 bash[91918]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:38 smithi089 bash[91918]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:38 smithi110 bash[70834]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:38 smithi110 bash[70834]: cluster 2024-09-21T05:34:36.847730+0000 mgr.y (mgr.25142) 507 : cluster [DBG] pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:39.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:39 smithi089 bash[88398]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:39.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:39 smithi089 bash[88398]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:39 smithi089 bash[91918]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:39.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:39 smithi089 bash[91918]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:39 smithi110 bash[70834]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:39 smithi110 bash[70834]: audit 2024-09-21T05:34:38.464391+0000 mgr.y (mgr.25142) 508 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:40.041757742Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:40 smithi089 bash[88398]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:40 smithi089 bash[88398]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:40 smithi089 bash[91918]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:40 smithi089 bash[91918]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:40 smithi110 bash[70834]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:40 smithi110 bash[70834]: cluster 2024-09-21T05:34:38.848754+0000 mgr.y (mgr.25142) 509 : cluster [DBG] pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:42 smithi089 bash[88398]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:42.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:42 smithi089 bash[88398]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:42 smithi089 bash[91918]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:42 smithi089 bash[91918]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:42 smithi110 bash[70834]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:42 smithi110 bash[70834]: cluster 2024-09-21T05:34:40.850200+0000 mgr.y (mgr.25142) 510 : cluster [DBG] pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:43.025697032Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:44.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:44 smithi089 bash[88398]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:44.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:44 smithi089 bash[88398]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:44.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:44 smithi089 bash[91918]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:44.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:44 smithi089 bash[91918]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:44 smithi110 bash[70834]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:44.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:44 smithi110 bash[70834]: cluster 2024-09-21T05:34:42.851084+0000 mgr.y (mgr.25142) 511 : cluster [DBG] pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:46.024959146Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:46.495 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:46] "GET /metrics HTTP/1.1" 200 38353 "" "Prometheus/2.51.0" 2024-09-21T05:34:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:46 smithi089 bash[88398]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:46 smithi089 bash[88398]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:46 smithi089 bash[91918]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:46 smithi089 bash[91918]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:46 smithi110 bash[70834]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:46 smithi110 bash[70834]: cluster 2024-09-21T05:34:44.851954+0000 mgr.y (mgr.25142) 512 : cluster [DBG] pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:48.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:48 smithi089 bash[91918]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:48 smithi089 bash[91918]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:48 smithi089 bash[88398]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:48 smithi089 bash[88398]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:48 smithi110 bash[70834]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:48 smithi110 bash[70834]: cluster 2024-09-21T05:34:46.853414+0000 mgr.y (mgr.25142) 513 : cluster [DBG] pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:49.508 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:49.059078724Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:49 smithi089 bash[91918]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:49.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:49 smithi089 bash[91918]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:49 smithi089 bash[88398]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:49.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:49 smithi089 bash[88398]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:49 smithi110 bash[70834]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:49 smithi110 bash[70834]: audit 2024-09-21T05:34:48.474102+0000 mgr.y (mgr.25142) 514 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:50.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[91918]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[91918]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[91918]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[91918]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[88398]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[88398]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[88398]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:50 smithi089 bash[88398]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:50 smithi110 bash[70834]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:50 smithi110 bash[70834]: cluster 2024-09-21T05:34:48.854531+0000 mgr.y (mgr.25142) 515 : cluster [DBG] pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:50 smithi110 bash[70834]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:50 smithi110 bash[70834]: audit 2024-09-21T05:34:50.462292+0000 mon.b (mon.1) 144 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:34:52.514 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:52.06053064Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:52 smithi089 bash[88398]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:52 smithi089 bash[88398]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:52 smithi089 bash[91918]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:52 smithi089 bash[91918]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:52 smithi110 bash[70834]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:52 smithi110 bash[70834]: cluster 2024-09-21T05:34:50.856046+0000 mgr.y (mgr.25142) 516 : cluster [DBG] pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:54.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:34:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:54 smithi089 bash[88398]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:54 smithi089 bash[88398]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:54.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:54 smithi089 bash[91918]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:54 smithi089 bash[91918]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:54 smithi110 bash[70834]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:54 smithi110 bash[70834]: cluster 2024-09-21T05:34:52.856961+0000 mgr.y (mgr.25142) 517 : cluster [DBG] pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:55.04755577Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:55.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:55 smithi089 bash[88398]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:55 smithi089 bash[88398]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:55 smithi089 bash[91918]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:55 smithi089 bash[91918]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:55 smithi110 bash[70834]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:55.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:55 smithi110 bash[70834]: audit 2024-09-21T05:34:53.935893+0000 mgr.y (mgr.25142) 518 : audit [DBG] from='client.54254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:34:56.532 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:34:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:34:56] "GET /metrics HTTP/1.1" 200 38353 "" "Prometheus/2.51.0" 2024-09-21T05:34:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:56 smithi089 bash[91918]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:56 smithi089 bash[91918]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:56.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:56 smithi089 bash[88398]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:56.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:56 smithi089 bash[88398]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:56 smithi110 bash[70834]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:56 smithi110 bash[70834]: cluster 2024-09-21T05:34:54.857538+0000 mgr.y (mgr.25142) 519 : cluster [DBG] pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:34:58.536 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:34:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:34:58.068332481Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:34:58.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:58 smithi089 bash[88398]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:58 smithi089 bash[88398]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:58 smithi089 bash[91918]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:58 smithi089 bash[91918]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:58 smithi110 bash[70834]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:58 smithi110 bash[70834]: cluster 2024-09-21T05:34:56.858953+0000 mgr.y (mgr.25142) 520 : cluster [DBG] pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:34:59.473 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:34:59.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:59 smithi089 bash[88398]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:59.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:34:59 smithi089 bash[88398]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:59.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:59 smithi089 bash[91918]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:59.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:34:59 smithi089 bash[91918]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:59 smithi110 bash[70834]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:34:59.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:34:59 smithi110 bash[70834]: audit 2024-09-21T05:34:58.482185+0000 mgr.y (mgr.25142) 521 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:00 smithi089 bash[88398]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:00 smithi089 bash[88398]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:00 smithi089 bash[91918]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:00.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:00 smithi089 bash[91918]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:00 smithi110 bash[70834]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:00 smithi110 bash[70834]: cluster 2024-09-21T05:34:58.859984+0000 mgr.y (mgr.25142) 522 : cluster [DBG] pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:01.159 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (7m) 45s ago 34m 13.9M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (6m) 5m ago 34m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (9m) 45s ago 31m 49.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (9m) 5m ago 42m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (19m) 45s ago 45m 517M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (3m) 45s ago 45m 49.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (5m) 5m ago 43m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (3m) 45s ago 43m 34.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (8m) 45s ago 34m 8628k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (8m) 5m ago 34m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (89s) 45s ago 42m 45.7M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running 45s ago 41m - 3036M 2024-09-21T05:35:01.160 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (40m) 45s ago 40m 65.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (39m) 45s ago 39m 62.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (38m) 5m ago 38m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (37m) 5m ago 37m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (36m) 5m ago 36m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (35m) 5m ago 35m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (8m) 5m ago 34m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (32m) 45s ago 32m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:35:01.161 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (32m) 5m ago 32m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:35:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:01.044617005Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:01.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-09-21T05:35:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:02 smithi110 bash[70834]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:02 smithi110 bash[70834]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:02 smithi110 bash[70834]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:02 smithi110 bash[70834]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[88398]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[88398]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[88398]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[88398]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[91918]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[91918]: cluster 2024-09-21T05:35:00.860781+0000 mgr.y (mgr.25142) 523 : cluster [DBG] pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[91918]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:03.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:02 smithi089 bash[91918]: audit 2024-09-21T05:35:01.143289+0000 mgr.y (mgr.25142) 524 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:04.048987196Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:04 smithi089 bash[88398]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:04 smithi089 bash[88398]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:04 smithi089 bash[91918]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:04 smithi089 bash[91918]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:04 smithi110 bash[70834]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:04 smithi110 bash[70834]: cluster 2024-09-21T05:35:02.861663+0000 mgr.y (mgr.25142) 525 : cluster [DBG] pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:05 smithi089 bash[88398]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:05 smithi089 bash[88398]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:05 smithi089 bash[91918]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:05 smithi089 bash[91918]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:05 smithi110 bash[70834]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:05 smithi110 bash[70834]: audit 2024-09-21T05:35:05.462583+0000 mon.b (mon.1) 145 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:06] "GET /metrics HTTP/1.1" 200 38353 "" "Prometheus/2.51.0" 2024-09-21T05:35:06.720 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:06.969 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:06 smithi089 bash[88398]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:06.969 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:06 smithi089 bash[88398]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:06.970 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:06 smithi089 bash[91918]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:06.970 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:06 smithi089 bash[91918]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:06 smithi110 bash[70834]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:06 smithi110 bash[70834]: cluster 2024-09-21T05:35:04.862583+0000 mgr.y (mgr.25142) 526 : cluster [DBG] pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:07.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:07.056702762Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:08.239 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:35:08.995 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[88398]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:08.995 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[88398]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:08.995 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[88398]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:08.995 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[88398]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:08.996 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[91918]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:08.996 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[91918]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:08.996 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[91918]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:08.996 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:08 smithi089 bash[91918]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:08.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 7'"'"'' 2024-09-21T05:35:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:08 smithi110 bash[70834]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:08 smithi110 bash[70834]: cluster 2024-09-21T05:35:06.864078+0000 mgr.y (mgr.25142) 527 : cluster [DBG] pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:08 smithi110 bash[70834]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:08 smithi110 bash[70834]: audit 2024-09-21T05:35:08.228366+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.89:0/1058218758' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:10.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:09 smithi110 bash[70834]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:09 smithi110 bash[70834]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:09 smithi089 bash[88398]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:09 smithi089 bash[88398]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:09 smithi089 bash[91918]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:09 smithi089 bash[91918]: audit 2024-09-21T05:35:08.490204+0000 mgr.y (mgr.25142) 528 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:10.039059096Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:10 smithi089 bash[88398]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:10 smithi089 bash[88398]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:10 smithi089 bash[91918]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:10 smithi089 bash[91918]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:10 smithi110 bash[70834]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:10 smithi110 bash[70834]: cluster 2024-09-21T05:35:08.865151+0000 mgr.y (mgr.25142) 529 : cluster [DBG] pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:12 smithi089 bash[88398]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:12 smithi089 bash[88398]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:12 smithi089 bash[91918]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:12 smithi089 bash[91918]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:12 smithi110 bash[70834]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:12 smithi110 bash[70834]: cluster 2024-09-21T05:35:10.866613+0000 mgr.y (mgr.25142) 530 : cluster [DBG] pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:13.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:13.059292461Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:13.815 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:14.877 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:14 smithi089 bash[88398]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:14.877 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:14 smithi089 bash[88398]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:14.877 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:14 smithi089 bash[91918]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:14.877 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:14 smithi089 bash[91918]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:14 smithi110 bash[70834]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:14 smithi110 bash[70834]: cluster 2024-09-21T05:35:12.867533+0000 mgr.y (mgr.25142) 531 : cluster [DBG] pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:16.022817378Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:16] "GET /metrics HTTP/1.1" 200 38353 "" "Prometheus/2.51.0" 2024-09-21T05:35:16.900 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[88398]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:16.900 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[88398]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:16.900 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[88398]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:16.900 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[88398]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:16.901 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[91918]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:16.901 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[91918]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:16.901 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[91918]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:16.901 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:16 smithi089 bash[91918]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:16 smithi110 bash[70834]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:16 smithi110 bash[70834]: cluster 2024-09-21T05:35:14.868519+0000 mgr.y (mgr.25142) 532 : cluster [DBG] pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:16 smithi110 bash[70834]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:16 smithi110 bash[70834]: audit 2024-09-21T05:35:15.252017+0000 mgr.y (mgr.25142) 533 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:17.789 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:35:18.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:35:18.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:18 smithi089 bash[88398]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:18.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:18 smithi089 bash[88398]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:18 smithi089 bash[91918]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:18 smithi089 bash[91918]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:19.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:18 smithi110 bash[70834]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:19.049 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:18 smithi110 bash[70834]: cluster 2024-09-21T05:35:16.870058+0000 mgr.y (mgr.25142) 534 : cluster [DBG] pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:19.049957266Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:19 smithi089 bash[88398]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:19 smithi089 bash[88398]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:20.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:19 smithi089 bash[91918]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:19 smithi089 bash[91918]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:19 smithi110 bash[70834]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:19 smithi110 bash[70834]: audit 2024-09-21T05:35:18.498153+0000 mgr.y (mgr.25142) 535 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[88398]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[88398]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[88398]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[88398]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[91918]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[91918]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[91918]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:20 smithi089 bash[91918]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:20 smithi110 bash[70834]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:20 smithi110 bash[70834]: cluster 2024-09-21T05:35:18.871118+0000 mgr.y (mgr.25142) 536 : cluster [DBG] pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:20 smithi110 bash[70834]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:20 smithi110 bash[70834]: audit 2024-09-21T05:35:20.463023+0000 mon.b (mon.1) 146 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:22.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:22.060759762Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:22 smithi089 bash[88398]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:22 smithi089 bash[88398]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:22 smithi089 bash[91918]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:22 smithi089 bash[91918]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:22 smithi110 bash[70834]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:22 smithi110 bash[70834]: cluster 2024-09-21T05:35:20.872577+0000 mgr.y (mgr.25142) 537 : cluster [DBG] pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:23.278 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:24 smithi089 bash[88398]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:24 smithi089 bash[88398]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:24 smithi089 bash[91918]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:24 smithi089 bash[91918]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:35:24.798 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:35:24.799 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:35:24.799 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:35:25.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:24 smithi110 bash[70834]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:25.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:24 smithi110 bash[70834]: cluster 2024-09-21T05:35:22.873556+0000 mgr.y (mgr.25142) 538 : cluster [DBG] pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:25.039935084Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:25.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:35:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:26] "GET /metrics HTTP/1.1" 200 38352 "" "Prometheus/2.51.0" 2024-09-21T05:35:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[88398]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[88398]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[88398]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[88398]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[91918]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[91918]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[91918]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:26 smithi089 bash[91918]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:26 smithi110 bash[70834]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:26 smithi110 bash[70834]: audit 2024-09-21T05:35:24.798553+0000 mgr.y (mgr.25142) 539 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:26 smithi110 bash[70834]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:26 smithi110 bash[70834]: cluster 2024-09-21T05:35:24.874059+0000 mgr.y (mgr.25142) 540 : cluster [DBG] pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:28.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:28.060346979Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[88398]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:28.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:28.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:28.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:28.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:28 smithi089 bash[91918]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: cluster 2024-09-21T05:35:26.875429+0000 mgr.y (mgr.25142) 541 : cluster [DBG] pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.724118+0000 mon.b (mon.1) 147 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.726069+0000 mon.b (mon.1) 148 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:28 smithi110 bash[70834]: audit 2024-09-21T05:35:27.736322+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:30.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:29 smithi089 bash[88398]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:29 smithi089 bash[88398]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:29 smithi089 bash[91918]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:29 smithi089 bash[91918]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:29 smithi110 bash[70834]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:29 smithi110 bash[70834]: audit 2024-09-21T05:35:28.500402+0000 mgr.y (mgr.25142) 542 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:30.410 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:30 smithi089 bash[88398]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:30.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:30 smithi089 bash[88398]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:30 smithi089 bash[91918]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:30 smithi089 bash[91918]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:31.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:30 smithi110 bash[70834]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:31.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:30 smithi110 bash[70834]: cluster 2024-09-21T05:35:28.876661+0000 mgr.y (mgr.25142) 543 : cluster [DBG] pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:31.038483327Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:32.128 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:35:32.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1' 2024-09-21T05:35:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[88398]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[88398]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[88398]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[88398]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[91918]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[91918]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[91918]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:32 smithi089 bash[91918]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:32 smithi110 bash[70834]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:32 smithi110 bash[70834]: cluster 2024-09-21T05:35:30.878170+0000 mgr.y (mgr.25142) 544 : cluster [DBG] pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:32 smithi110 bash[70834]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:32 smithi110 bash[70834]: audit 2024-09-21T05:35:32.128806+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.15.89:0/377532106' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:35:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:34.023034051Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:34 smithi089 bash[88398]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:34 smithi089 bash[88398]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:35.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:34 smithi089 bash[91918]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:34 smithi089 bash[91918]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:34 smithi110 bash[70834]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:34 smithi110 bash[70834]: cluster 2024-09-21T05:35:32.879131+0000 mgr.y (mgr.25142) 545 : cluster [DBG] pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:35 smithi089 bash[88398]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:35 smithi089 bash[88398]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:35 smithi089 bash[91918]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:35 smithi089 bash[91918]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:35 smithi110 bash[70834]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:35 smithi110 bash[70834]: audit 2024-09-21T05:35:35.463351+0000 mon.b (mon.1) 149 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:36] "GET /metrics HTTP/1.1" 200 38351 "" "Prometheus/2.51.0" 2024-09-21T05:35:37.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:36 smithi110 bash[70834]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:36 smithi110 bash[70834]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:36 smithi089 bash[88398]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:36 smithi089 bash[88398]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:36 smithi089 bash[91918]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:36 smithi089 bash[91918]: cluster 2024-09-21T05:35:34.880011+0000 mgr.y (mgr.25142) 546 : cluster [DBG] pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:37.039085079Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:37.684 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:38 smithi089 bash[88398]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:38 smithi089 bash[88398]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:38.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:38 smithi089 bash[91918]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:38.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:38 smithi089 bash[91918]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:38 smithi110 bash[70834]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:38 smithi110 bash[70834]: cluster 2024-09-21T05:35:36.881486+0000 mgr.y (mgr.25142) 547 : cluster [DBG] pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:40.045 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:39 smithi110 bash[70834]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.045 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:39 smithi110 bash[70834]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:39 smithi089 bash[88398]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:39 smithi089 bash[88398]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:39 smithi089 bash[91918]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:39 smithi089 bash[91918]: audit 2024-09-21T05:35:38.511160+0000 mgr.y (mgr.25142) 548 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:40.046597496Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:40.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[88398]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:40.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[88398]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:40.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[88398]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:40.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[88398]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:40.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[91918]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:40.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[91918]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:40.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[91918]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:40.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:40 smithi089 bash[91918]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:40 smithi110 bash[70834]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:40 smithi110 bash[70834]: cluster 2024-09-21T05:35:38.882078+0000 mgr.y (mgr.25142) 549 : cluster [DBG] pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:40 smithi110 bash[70834]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:40 smithi110 bash[70834]: audit 2024-09-21T05:35:39.203456+0000 mgr.y (mgr.25142) 550 : audit [DBG] from='client.54290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:41.691 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:42.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:35:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[91918]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:42.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:42 smithi089 bash[88398]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:43.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: cluster 2024-09-21T05:35:40.882980+0000 mgr.y (mgr.25142) 551 : cluster [DBG] pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: cephadm 2024-09-21T05:35:41.683325+0000 mgr.y (mgr.25142) 552 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.691158+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.694290+0000 mon.b (mon.1) 150 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.696070+0000 mon.b (mon.1) 151 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:43.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:42 smithi110 bash[70834]: audit 2024-09-21T05:35:41.703317+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:43.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:43.056220215Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:43 smithi089 bash[88398]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:43 smithi089 bash[88398]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:44.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:43 smithi089 bash[91918]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:43 smithi089 bash[91918]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:43 smithi110 bash[70834]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:43 smithi110 bash[70834]: cephadm 2024-09-21T05:35:41.771244+0000 mgr.y (mgr.25142) 553 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[88398]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:44 smithi089 bash[91918]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: cluster 2024-09-21T05:35:42.883849+0000 mgr.y (mgr.25142) 554 : cluster [DBG] pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.185335+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.191811+0000 mon.b (mon.1) 152 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.196061+0000 mon.b (mon.1) 153 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.206463+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.214074+0000 mon.b (mon.1) 154 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.224538+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.231144+0000 mon.b (mon.1) 155 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.241304+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:44 smithi110 bash[70834]: audit 2024-09-21T05:35:44.249193+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T05:35:45.979 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:45.979 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:45.979 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:45.979 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:45.979 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[91918]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:45.980 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:45.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:45 smithi089 bash[88398]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.187141+0000 mgr.y (mgr.25142) 555 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.187297+0000 mgr.y (mgr.25142) 556 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.196894+0000 mgr.y (mgr.25142) 557 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.215211+0000 mgr.y (mgr.25142) 558 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.232130+0000 mgr.y (mgr.25142) 559 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: audit 2024-09-21T05:35:44.249174+0000 mgr.y (mgr.25142) 560 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:46.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:45 smithi110 bash[70834]: cephadm 2024-09-21T05:35:44.252089+0000 mgr.y (mgr.25142) 561 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-09-21T05:35:46.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:46] "GET /metrics HTTP/1.1" 200 38351 "" "Prometheus/2.51.0" 2024-09-21T05:35:46.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:46.058745921Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:46 smithi089 bash[88398]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:46 smithi089 bash[88398]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:46 smithi089 bash[91918]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:46 smithi089 bash[91918]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:46 smithi110 bash[70834]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:46 smithi110 bash[70834]: cluster 2024-09-21T05:35:44.884805+0000 mgr.y (mgr.25142) 562 : cluster [DBG] pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:48.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:47 smithi110 bash[70834]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[88398]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cephadm 2024-09-21T05:35:46.786400+0000 mgr.y (mgr.25142) 563 : cephadm [INF] Upgrade: Updating osd.2 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.793308+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.800208+0000 mon.b (mon.1) 157 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: audit 2024-09-21T05:35:46.801739+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:35:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cephadm 2024-09-21T05:35:46.804932+0000 mgr.y (mgr.25142) 564 : cephadm [INF] Deploying daemon osd.2 on smithi089 2024-09-21T05:35:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:47 smithi089 bash[91918]: cluster 2024-09-21T05:35:46.886293+0000 mgr.y (mgr.25142) 565 : cluster [DBG] pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:49.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:49.044563616Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:48 smithi110 bash[70834]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:48 smithi110 bash[70834]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:49.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:48 smithi089 bash[88398]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:49.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:48 smithi089 bash[88398]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:49.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:48 smithi089 bash[91918]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:49.061 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:48 smithi089 bash[91918]: audit 2024-09-21T05:35:48.522190+0000 mgr.y (mgr.25142) 566 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:35:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:49 smithi089 bash[88398]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:49 smithi089 bash[88398]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:49 smithi089 bash[91918]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:49 smithi089 bash[91918]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:49 smithi110 bash[70834]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:49 smithi110 bash[70834]: cluster 2024-09-21T05:35:48.887269+0000 mgr.y (mgr.25142) 567 : cluster [DBG] pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:50.585 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (8m) 95s ago 35m 13.9M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (7m) 5m ago 35m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (10m) 95s ago 32m 49.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (9m) 5m ago 43m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (20m) 95s ago 45m 517M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:35:51.202 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (4m) 95s ago 46m 49.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (5m) 5m ago 44m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (4m) 95s ago 44m 34.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (9m) 95s ago 35m 8628k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (9m) 5m ago 35m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 95s ago 43m 45.7M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running 95s ago 42m - 3036M 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (41m) 95s ago 41m 65.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a a109a3ee7c6c 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (40m) 95s ago 40m 62.3M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (39m) 5m ago 39m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (38m) 5m ago 38m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (37m) 5m ago 37m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (36m) 5m ago 36m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (8m) 5m ago 35m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:35:51.203 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (33m) 95s ago 33m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:35:51.204 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (33m) 5m ago 33m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[88398]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[88398]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[88398]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[88398]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[91918]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[91918]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[91918]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:50 smithi089 bash[91918]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:50 smithi110 bash[70834]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:50 smithi110 bash[70834]: audit 2024-09-21T05:35:50.463770+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:35:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:50 smithi110 bash[70834]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:50 smithi110 bash[70834]: audit 2024-09-21T05:35:50.574294+0000 mgr.y (mgr.25142) 568 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:35:51.586 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:35:51.587 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 7 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:35:51.588 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd. Upgrade limited to 1 daemons (1 remaining).", 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/8 daemons upgraded", 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:35:51.899 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:35:51.900 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:35:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[88398]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:51 smithi089 bash[91918]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:52.062286467Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:50.870326+0000 mgr.y (mgr.25142) 569 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: cluster 2024-09-21T05:35:50.887982+0000 mgr.y (mgr.25142) 570 : cluster [DBG] pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:51.181190+0000 mgr.y (mgr.25142) 571 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:51 smithi110 bash[70834]: audit 2024-09-21T05:35:51.586652+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.89:0/3388271492' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:35:52.963 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.963 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.964 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.964 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.964 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.965 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:52 smithi089 bash[88398]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.965 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:52 smithi089 bash[88398]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.965 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.965 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.965 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:52.965 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:52 smithi089 bash[91918]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.965 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:52 smithi089 bash[91918]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:52.966 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:53.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:52 smithi089 systemd[1]: Stopping Ceph osd.2 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:35:53.297 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[40064]: debug 2024-09-21T05:35:53.075+0000 7f8f5dd09640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:35:53.297 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[40064]: debug 2024-09-21T05:35:53.075+0000 7f8f5dd09640 -1 osd.2 122 *** Got signal Terminated *** 2024-09-21T05:35:53.297 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[40064]: debug 2024-09-21T05:35:53.075+0000 7f8f5dd09640 -1 osd.2 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:35:53.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:52 smithi110 bash[70834]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:53.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:52 smithi110 bash[70834]: audit 2024-09-21T05:35:51.899620+0000 mgr.y (mgr.25142) 572 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:35:54.267 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[88398]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[88398]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[91918]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[91918]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:54.268 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:53 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:53 smithi110 bash[70834]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:53 smithi110 bash[70834]: cluster 2024-09-21T05:35:52.888447+0000 mgr.y (mgr.25142) 573 : cluster [DBG] pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:35:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:53 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:53 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.078593+0000 mon.a (mon.0) 219 : cluster [INF] osd.2 marked itself down and dead 2024-09-21T05:35:55.112 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[107070]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-2 2024-09-21T05:35:55.112 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[88398]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.113 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:54 smithi089 bash[91918]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:55.031615306Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:55.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:54 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:54 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.822314+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:35:55.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:54 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:54 smithi110 bash[70834]: cluster 2024-09-21T05:35:53.839746+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e123: 8 total, 7 up, 8 in 2024-09-21T05:35:55.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[107133]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-2 2024-09-21T05:35:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[88398]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[88398]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[88398]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.196 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[88398]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[91918]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[91918]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[91918]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:55 smithi089 bash[91918]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:55 smithi110 bash[70834]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:55 smithi110 bash[70834]: cluster 2024-09-21T05:35:54.842412+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e124: 8 total, 7 up, 8 in 2024-09-21T05:35:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:55 smithi110 bash[70834]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:55 smithi110 bash[70834]: cluster 2024-09-21T05:35:54.889030+0000 mgr.y (mgr.25142) 574 : cluster [DBG] pgmap v325: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:35:56.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:35:56] "GET /metrics HTTP/1.1" 200 38352 "" "Prometheus/2.51.0" 2024-09-21T05:35:57.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:56 smithi089 bash[88398]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:56 smithi089 bash[88398]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:56 smithi089 bash[91918]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:56 smithi089 bash[91918]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:56 smithi110 bash[70834]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:56 smithi110 bash[70834]: cluster 2024-09-21T05:35:56.942772+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T05:35:57.661 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.661 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.661 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.662 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.662 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.662 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T05:35:57.662 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: Stopped Ceph osd.2 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:35:57.662 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.663 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.663 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:57.663 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:35:58.046 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:57 smithi089 systemd[1]: Started Ceph osd.2 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:35:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:35:58.04937685Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:35:58.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:58.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:58.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[91918]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:58.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[88398]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: cluster 2024-09-21T05:35:56.890694+0000 mgr.y (mgr.25142) 575 : cluster [DBG] pgmap v326: 161 pgs: 20 active+undersized, 4 stale+active+clean, 12 active+undersized+degraded, 125 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 39/732 objects degraded (5.328%) 2024-09-21T05:35:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.711388+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.721996+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:58 smithi110 bash[70834]: audit 2024-09-21T05:35:57.730714+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:35:59.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:58 smithi089 bash[107280]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:35:59.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:35:59 smithi089 bash[107280]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:36:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:59 smithi089 bash[88398]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:00.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:35:59 smithi089 bash[88398]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:00.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:59 smithi089 bash[91918]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:35:59 smithi089 bash[91918]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:59 smithi110 bash[70834]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:35:59 smithi110 bash[70834]: audit 2024-09-21T05:35:58.533537+0000 mgr.y (mgr.25142) 576 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:01.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:00 smithi089 bash[91918]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:00 smithi089 bash[91918]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:00 smithi089 bash[88398]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:00 smithi089 bash[88398]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.050 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:00 smithi110 bash[70834]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.050 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:00 smithi110 bash[70834]: cluster 2024-09-21T05:35:58.891426+0000 mgr.y (mgr.25142) 577 : cluster [DBG] pgmap v327: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:01.051487514Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[88398]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[88398]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[91918]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[91918]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[107280]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:36:03.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[107280]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:36:03.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[107280]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:36:03.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[107280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T05:36:03.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:02 smithi089 bash[107280]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T05:36:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:02 smithi110 bash[70834]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:02 smithi110 bash[70834]: cluster 2024-09-21T05:36:00.893316+0000 mgr.y (mgr.25142) 578 : cluster [DBG] pgmap v328: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:03.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:03 smithi089 bash[107280]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T05:36:03.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:03 smithi089 bash[107280]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T05:36:03.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:03 smithi089 bash[107280]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T05:36:03.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:03 smithi089 bash[107280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T05:36:03.546 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:03 smithi089 bash[107280]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T05:36:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:04.043761891Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[88398]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:04 smithi089 bash[91918]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: cluster 2024-09-21T05:36:02.893993+0000 mgr.y (mgr.25142) 579 : cluster [DBG] pgmap v329: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: audit 2024-09-21T05:36:03.600228+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: audit 2024-09-21T05:36:03.611626+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:04 smithi110 bash[70834]: cluster 2024-09-21T05:36:04.401895+0000 mon.a (mon.0) 229 : cluster [WRN] Health check update: Degraded data redundancy: 67/732 objects degraded (9.153%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:05.683 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[107968]: debug 2024-09-21T05:36:05.391+0000 7f1be80a0640 1 -- 172.21.15.89:0/3158418499 <== mon.2 v2:172.21.15.89:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b53ae76960 con 0x55b53bc64000 2024-09-21T05:36:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[88398]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:05 smithi089 bash[91918]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:04.684294+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:04.695095+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:05.467570+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:05 smithi110 bash[70834]: audit 2024-09-21T05:36:05.472746+0000 mon.b (mon.1) 160 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:06] "GET /metrics HTTP/1.1" 200 38349 "" "Prometheus/2.51.0" 2024-09-21T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:06 smithi110 bash[70834]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:06 smithi110 bash[70834]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.046 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[107968]: debug 2024-09-21T05:36:06.746+0000 7f1bea907640 -1 Falling back to public interface 2024-09-21T05:36:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[88398]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[88398]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[91918]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:06 smithi089 bash[91918]: cluster 2024-09-21T05:36:04.894968+0000 mgr.y (mgr.25142) 580 : cluster [DBG] pgmap v330: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:07.038810095Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:08.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:08 smithi089 bash[91918]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:08.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:08 smithi089 bash[91918]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:08 smithi089 bash[88398]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:08.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:08 smithi089 bash[88398]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:08 smithi110 bash[70834]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:08 smithi110 bash[70834]: cluster 2024-09-21T05:36:06.896590+0000 mgr.y (mgr.25142) 581 : cluster [DBG] pgmap v331: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 67/732 objects degraded (9.153%) 2024-09-21T05:36:10.012 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:09 smithi089 bash[88398]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.012 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:09 smithi089 bash[88398]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.012 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:09 smithi089 bash[91918]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.013 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:09 smithi089 bash[91918]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:09 smithi110 bash[70834]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:09 smithi110 bash[70834]: audit 2024-09-21T05:36:08.543546+0000 mgr.y (mgr.25142) 582 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:10.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[107968]: debug 2024-09-21T05:36:10.006+0000 7f1bea907640 -1 osd.2 122 log_to_monitors true 2024-09-21T05:36:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:10.038261543Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:11.046 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[107968]: debug 2024-09-21T05:36:10.742+0000 7f1bde6a9640 -1 osd.2 122 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:36:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[88398]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[88398]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[88398]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[88398]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[91918]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[91918]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[91918]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:10 smithi089 bash[91918]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:10 smithi110 bash[70834]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:10 smithi110 bash[70834]: cluster 2024-09-21T05:36:08.897885+0000 mgr.y (mgr.25142) 583 : cluster [DBG] pgmap v332: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:10 smithi110 bash[70834]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:10 smithi110 bash[70834]: audit 2024-09-21T05:36:10.016671+0000 mon.a (mon.0) 233 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T05:36:12.006 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[88398]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.007 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.008 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:12.008 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:11 smithi089 bash[91918]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: audit 2024-09-21T05:36:10.712184+0000 mon.a (mon.0) 234 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T05:36:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: cluster 2024-09-21T05:36:10.719749+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e125: 8 total, 7 up, 8 in 2024-09-21T05:36:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:11 smithi110 bash[70834]: audit 2024-09-21T05:36:10.721856+0000 mon.a (mon.0) 236 : audit [INF] from='osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.025 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.026 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:12 smithi110 bash[70834]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[88398]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:10.898823+0000 mgr.y (mgr.25142) 584 : cluster [DBG] pgmap v334: 161 pgs: 31 active+undersized, 15 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 67/732 objects degraded (9.153%) 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.724332+0000 mon.a (mon.0) 237 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: audit 2024-09-21T05:36:11.733075+0000 mon.b (mon.1) 161 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T05:36:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.733638+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 [v2:172.21.15.89:6818/2784926094,v1:172.21.15.89:6819/2784926094] boot 2024-09-21T05:36:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:12 smithi089 bash[91918]: cluster 2024-09-21T05:36:11.733765+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-09-21T05:36:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:13.025927882Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[88398]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[88398]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[88398]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:14.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[88398]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:14.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[91918]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[91918]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[91918]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:14.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:13 smithi089 bash[91918]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:13 smithi110 bash[70834]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:13 smithi110 bash[70834]: cluster 2024-09-21T05:36:12.756941+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-09-21T05:36:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:13 smithi110 bash[70834]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:14.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:13 smithi110 bash[70834]: cluster 2024-09-21T05:36:12.899713+0000 mgr.y (mgr.25142) 585 : cluster [DBG] pgmap v337: 161 pgs: 5 peering, 28 active+undersized, 13 active+undersized+degraded, 115 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 45/732 objects degraded (6.148%) 2024-09-21T05:36:15.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:14 smithi089 bash[91918]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:15.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:14 smithi089 bash[91918]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:14 smithi089 bash[88398]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:14 smithi089 bash[88398]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:14 smithi110 bash[70834]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:14 smithi110 bash[70834]: cluster 2024-09-21T05:36:13.750242+0000 mon.a (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 45/732 objects degraded (6.148%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.199 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.200 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.201 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.202 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.203 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.204 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.205 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.206 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.207 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.208 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.209 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.210 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.211 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.212 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.213 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.214 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.215 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.216 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.217 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[88398]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.218 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.219 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.219 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.219 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.219 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:15 smithi089 bash[91918]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:16.035891184Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cluster 2024-09-21T05:36:14.900591+0000 mgr.y (mgr.25142) 586 : cluster [DBG] pgmap v338: 161 pgs: 5 peering, 24 active+undersized, 12 active+undersized+degraded, 120 active+clean; 585 KiB data, 270 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 39/732 objects degraded (5.328%) 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.939772+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.953829+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.959741+0000 mon.b (mon.1) 162 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.961847+0000 mon.b (mon.1) 163 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:14.972493+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.091168+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:36:16.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.094890+0000 mon.b (mon.1) 165 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.099027+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.100128+0000 mgr.y (mgr.25142) 587 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.107754+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.114221+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.118148+0000 mon.b (mon.1) 168 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.121760+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.307 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.125429+0000 mon.b (mon.1) 170 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.128892+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.132047+0000 mon.b (mon.1) 172 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.133477+0000 mgr.y (mgr.25142) 588 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.137480+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.137738+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.144049+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.308 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.148859+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.149255+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.155339+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.160299+0000 mon.b (mon.1) 175 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.160668+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.166693+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.171753+0000 mon.b (mon.1) 176 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.172037+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:36:16.309 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.174519+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.174835+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.177465+0000 mon.b (mon.1) 178 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.177816+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.180615+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.180922+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.183746+0000 mon.b (mon.1) 180 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.310 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.184073+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.186859+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.187229+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.190042+0000 mon.b (mon.1) 182 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.190362+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.193229+0000 mon.b (mon.1) 183 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.193534+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.311 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.196447+0000 mon.b (mon.1) 184 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.196773+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.202861+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.207832+0000 mon.b (mon.1) 185 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.312 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.208189+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.211827+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.212136+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.214876+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.215232+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.217758+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.218149+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.313 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.220643+0000 mon.b (mon.1) 189 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.221012+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.223822+0000 mon.b (mon.1) 190 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.224205+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: cephadm 2024-09-21T05:36:15.225975+0000 mgr.y (mgr.25142) 589 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.227389+0000 mon.b (mon.1) 191 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.227721+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:36:16.314 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.233995+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.236813+0000 mon.b (mon.1) 192 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.238452+0000 mon.b (mon.1) 193 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.249370+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.376586+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.378486+0000 mon.b (mon.1) 195 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.389360+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.315 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.316 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:15 smithi110 bash[70834]: audit 2024-09-21T05:36:15.657329+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:16] "GET /metrics HTTP/1.1" 200 38349 "" "Prometheus/2.51.0" 2024-09-21T05:36:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:17.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:17.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:17.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:16 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:16 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:16 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.939214+0000 mon.a (mon.0) 273 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/732 objects degraded (5.328%), 12 pgs degraded) 2024-09-21T05:36:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:16 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:17.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:16 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.939264+0000 mon.a (mon.0) 274 : cluster [INF] Cluster is now healthy 2024-09-21T05:36:18.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:17 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:18.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:17 smithi089 bash[88398]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:18.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:17 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:18.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:17 smithi089 bash[91918]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:18.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:17 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:18.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:17 smithi110 bash[70834]: cluster 2024-09-21T05:36:16.902091+0000 mgr.y (mgr.25142) 590 : cluster [DBG] pgmap v339: 161 pgs: 5 peering, 156 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 0 op/s 2024-09-21T05:36:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:19 smithi089 bash[88398]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:19.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:19 smithi089 bash[88398]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:19.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:19 smithi089 bash[91918]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:19.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:19 smithi089 bash[91918]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:19.060515338Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:19 smithi110 bash[70834]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:19 smithi110 bash[70834]: audit 2024-09-21T05:36:18.554629+0000 mgr.y (mgr.25142) 591 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:20.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:20 smithi089 bash[88398]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:20.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:20 smithi089 bash[88398]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:20.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:20 smithi089 bash[91918]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:20.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:20 smithi089 bash[91918]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:20.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:20 smithi110 bash[70834]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:20.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:20 smithi110 bash[70834]: cluster 2024-09-21T05:36:18.903129+0000 mgr.y (mgr.25142) 592 : cluster [DBG] pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:36:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[88398]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[88398]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[88398]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[88398]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[91918]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[91918]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[91918]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:21 smithi089 bash[91918]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:21 smithi110 bash[70834]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:21 smithi110 bash[70834]: audit 2024-09-21T05:36:20.472793+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:21 smithi110 bash[70834]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:21 smithi110 bash[70834]: audit 2024-09-21T05:36:20.475736+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:22.479 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:22.061590066Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:22.497 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:22 smithi089 bash[88398]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:22 smithi089 bash[88398]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:22 smithi089 bash[91918]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:22.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:22 smithi089 bash[91918]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:22 smithi110 bash[70834]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:22 smithi110 bash[70834]: cluster 2024-09-21T05:36:20.904572+0000 mgr.y (mgr.25142) 593 : cluster [DBG] pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:36:23.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:36:23.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:23 smithi089 bash[88398]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:23.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:23 smithi089 bash[88398]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:23.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:23 smithi089 bash[91918]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:23.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:23 smithi089 bash[91918]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:23 smithi110 bash[70834]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:23 smithi110 bash[70834]: audit 2024-09-21T05:36:22.226120+0000 mgr.y (mgr.25142) 594 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:24 smithi089 bash[88398]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:24 smithi089 bash[88398]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:24 smithi089 bash[91918]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:24 smithi089 bash[91918]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:24 smithi110 bash[70834]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:24 smithi110 bash[70834]: cluster 2024-09-21T05:36:22.905160+0000 mgr.y (mgr.25142) 595 : cluster [DBG] pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1008 B/s rd, 0 op/s 2024-09-21T05:36:25.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:25.06292838Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:26] "GET /metrics HTTP/1.1" 200 38344 "" "Prometheus/2.51.0" 2024-09-21T05:36:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[88398]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[88398]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[88398]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[88398]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[91918]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[91918]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[91918]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:26 smithi089 bash[91918]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:26 smithi110 bash[70834]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:26 smithi110 bash[70834]: cluster 2024-09-21T05:36:24.906023+0000 mgr.y (mgr.25142) 596 : cluster [DBG] pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:26 smithi110 bash[70834]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:26 smithi110 bash[70834]: audit 2024-09-21T05:36:25.673920+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:36:28.044 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:36:28.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:28.074857243Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:28 smithi089 bash[88398]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:28 smithi089 bash[88398]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:28 smithi089 bash[91918]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:28 smithi089 bash[91918]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:28 smithi110 bash[70834]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:28 smithi110 bash[70834]: cluster 2024-09-21T05:36:26.907491+0000 mgr.y (mgr.25142) 597 : cluster [DBG] pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:29.614 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:36:29.614 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (8m) 26s ago 35m 14.1M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:36:29.614 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (8m) 6m ago 35m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:36:29.614 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (10m) 26s ago 33m 49.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:36:29.614 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (10m) 6m ago 44m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (21m) 26s ago 46m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (5m) 26s ago 46m 50.0M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (6m) 6m ago 44m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (4m) 26s ago 44m 37.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (10m) 26s ago 36m 8999k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (10m) 6m ago 36m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 26s ago 43m 47.1M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 26s ago 42m 50.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running 26s ago 41m - 3036M 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (40m) 26s ago 40m 63.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (39m) 6m ago 40m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (39m) 6m ago 39m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (38m) 6m ago 38m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:36:29.615 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (37m) 6m ago 37m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:36:29.616 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (9m) 6m ago 36m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:36:29.616 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (33m) 26s ago 33m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:36:29.616 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (33m) 6m ago 33m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:36:30.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:29 smithi089 bash[88398]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:29 smithi089 bash[88398]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:29 smithi089 bash[91918]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:29 smithi089 bash[91918]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:29 smithi110 bash[70834]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:29 smithi110 bash[70834]: audit 2024-09-21T05:36:28.562082+0000 mgr.y (mgr.25142) 598 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:30.325 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-09-21T05:36:31.034 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:30 smithi110 bash[70834]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.035 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:30 smithi110 bash[70834]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.035 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:30 smithi110 bash[70834]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.035 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:30 smithi110 bash[70834]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[88398]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[88398]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[88398]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[88398]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[91918]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[91918]: cluster 2024-09-21T05:36:28.908346+0000 mgr.y (mgr.25142) 599 : cluster [DBG] pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[91918]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:30 smithi089 bash[91918]: audit 2024-09-21T05:36:29.594367+0000 mgr.y (mgr.25142) 600 : audit [DBG] from='client.54338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:31.035786111Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:32 smithi089 bash[88398]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:32 smithi089 bash[88398]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:33.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:32 smithi089 bash[91918]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:32 smithi089 bash[91918]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:32 smithi110 bash[70834]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:32 smithi110 bash[70834]: cluster 2024-09-21T05:36:30.909774+0000 mgr.y (mgr.25142) 601 : cluster [DBG] pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:34.035339947Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:34 smithi089 bash[88398]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:34 smithi089 bash[88398]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:34 smithi089 bash[91918]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:34 smithi089 bash[91918]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:34 smithi110 bash[70834]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:34 smithi110 bash[70834]: cluster 2024-09-21T05:36:32.910647+0000 mgr.y (mgr.25142) 602 : cluster [DBG] pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:35.148 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:36:36.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:35 smithi089 bash[91918]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:35 smithi089 bash[91918]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:35 smithi089 bash[88398]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:35 smithi089 bash[88398]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:35 smithi110 bash[70834]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:35 smithi110 bash[70834]: audit 2024-09-21T05:36:35.464597+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:36.532 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:36] "GET /metrics HTTP/1.1" 200 38343 "" "Prometheus/2.51.0" 2024-09-21T05:36:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:36 smithi089 bash[88398]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:36 smithi089 bash[88398]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:36 smithi089 bash[91918]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:36.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:36 smithi089 bash[91918]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:36.959 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:36:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:36 smithi110 bash[70834]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:37.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:36 smithi110 bash[70834]: cluster 2024-09-21T05:36:34.911531+0000 mgr.y (mgr.25142) 603 : cluster [DBG] pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:37.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:37.058212824Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:37.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 8'"'"'' 2024-09-21T05:36:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:37 smithi089 bash[88398]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:37 smithi089 bash[88398]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:38.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:37 smithi089 bash[91918]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:38.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:37 smithi089 bash[91918]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:37 smithi110 bash[70834]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:37 smithi110 bash[70834]: audit 2024-09-21T05:36:36.947040+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.15.89:0/2931731051' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:36:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:38 smithi089 bash[88398]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:38 smithi089 bash[88398]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:39.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:38 smithi089 bash[91918]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:39.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:38 smithi089 bash[91918]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:38 smithi110 bash[70834]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:38 smithi110 bash[70834]: cluster 2024-09-21T05:36:36.913000+0000 mgr.y (mgr.25142) 604 : cluster [DBG] pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:40.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:39 smithi110 bash[70834]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.027 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:39 smithi110 bash[70834]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:39 smithi089 bash[91918]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:39 smithi089 bash[91918]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:39 smithi089 bash[88398]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:39 smithi089 bash[88398]: audit 2024-09-21T05:36:38.573294+0000 mgr.y (mgr.25142) 605 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:40.027740739Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:40 smithi089 bash[88398]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:40 smithi089 bash[88398]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:41.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:40 smithi089 bash[91918]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:41.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:40 smithi089 bash[91918]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:40 smithi110 bash[70834]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:40 smithi110 bash[70834]: cluster 2024-09-21T05:36:38.914135+0000 mgr.y (mgr.25142) 606 : cluster [DBG] pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:42.508 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:36:43.032 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:42 smithi110 bash[70834]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.032 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:42 smithi110 bash[70834]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:42 smithi089 bash[88398]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:42 smithi089 bash[88398]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:42 smithi089 bash[91918]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:42 smithi089 bash[91918]: cluster 2024-09-21T05:36:40.915637+0000 mgr.y (mgr.25142) 607 : cluster [DBG] pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:43.032880517Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:44 smithi089 bash[88398]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:44 smithi089 bash[88398]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:45.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:44 smithi089 bash[91918]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:45.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:44 smithi089 bash[91918]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:44 smithi110 bash[70834]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:44 smithi110 bash[70834]: cluster 2024-09-21T05:36:42.916546+0000 mgr.y (mgr.25142) 608 : cluster [DBG] pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:46.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:45 smithi110 bash[70834]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.028 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:45 smithi110 bash[70834]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:45 smithi089 bash[88398]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:45 smithi089 bash[88398]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:45 smithi089 bash[91918]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:45 smithi089 bash[91918]: audit 2024-09-21T05:36:44.183145+0000 mgr.y (mgr.25142) 609 : audit [DBG] from='client.54350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:46.028892936Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:46] "GET /metrics HTTP/1.1" 200 38343 "" "Prometheus/2.51.0" 2024-09-21T05:36:46.636 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:36:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:46 smithi089 bash[88398]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:46 smithi089 bash[88398]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:46 smithi089 bash[91918]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:46 smithi089 bash[91918]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:46 smithi110 bash[70834]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:46 smithi110 bash[70834]: cluster 2024-09-21T05:36:44.917427+0000 mgr.y (mgr.25142) 610 : cluster [DBG] pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:47.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:36:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:47 smithi089 bash[88398]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:47 smithi089 bash[88398]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:47 smithi089 bash[91918]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:47 smithi089 bash[91918]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:47 smithi110 bash[70834]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:48.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:47 smithi110 bash[70834]: cluster 2024-09-21T05:36:46.918939+0000 mgr.y (mgr.25142) 611 : cluster [DBG] pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:49.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:48 smithi110 bash[70834]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:48 smithi110 bash[70834]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:48 smithi089 bash[88398]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:48 smithi089 bash[88398]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:48 smithi089 bash[91918]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:48 smithi089 bash[91918]: audit 2024-09-21T05:36:48.582137+0000 mgr.y (mgr.25142) 612 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:49.041922138Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:49 smithi089 bash[88398]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:49 smithi089 bash[88398]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:49 smithi089 bash[91918]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:49 smithi089 bash[91918]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:49 smithi110 bash[70834]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:49 smithi110 bash[70834]: cluster 2024-09-21T05:36:48.919971+0000 mgr.y (mgr.25142) 613 : cluster [DBG] pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:50 smithi089 bash[88398]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:50 smithi089 bash[88398]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:50 smithi089 bash[91918]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:50 smithi089 bash[91918]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:50 smithi110 bash[70834]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:50 smithi110 bash[70834]: audit 2024-09-21T05:36:50.465007+0000 mon.b (mon.1) 198 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:36:52.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:51 smithi089 bash[88398]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:51 smithi089 bash[88398]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:51 smithi089 bash[91918]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:51 smithi089 bash[91918]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:51 smithi110 bash[70834]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:51 smithi110 bash[70834]: cluster 2024-09-21T05:36:50.921363+0000 mgr.y (mgr.25142) 614 : cluster [DBG] pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:52.152 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:36:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:52.048108306Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:36:53.715 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:36:53.716 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:36:53.979 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[88398]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:53.979 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[88398]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[88398]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[88398]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[91918]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[91918]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[91918]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:53 smithi089 bash[91918]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:53 smithi110 bash[70834]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:53 smithi110 bash[70834]: cluster 2024-09-21T05:36:52.922272+0000 mgr.y (mgr.25142) 615 : cluster [DBG] pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:53 smithi110 bash[70834]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:53 smithi110 bash[70834]: audit 2024-09-21T05:36:53.715672+0000 mgr.y (mgr.25142) 616 : audit [DBG] from='client.54356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:36:54.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:36:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:55.02911634Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:56.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:36:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:36:56] "GET /metrics HTTP/1.1" 200 38344 "" "Prometheus/2.51.0" 2024-09-21T05:36:56.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:55 smithi089 bash[88398]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:56.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:55 smithi089 bash[88398]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:56.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:55 smithi089 bash[91918]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:56.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:55 smithi089 bash[91918]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:55 smithi110 bash[70834]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:55 smithi110 bash[70834]: cluster 2024-09-21T05:36:54.923145+0000 mgr.y (mgr.25142) 617 : cluster [DBG] pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:36:58.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:57 smithi089 bash[88398]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:58.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:57 smithi089 bash[88398]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:58.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:57 smithi089 bash[91918]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:58.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:57 smithi089 bash[91918]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:36:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:36:58.040948457Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:36:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:57 smithi110 bash[70834]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:57 smithi110 bash[70834]: cluster 2024-09-21T05:36:56.924593+0000 mgr.y (mgr.25142) 618 : cluster [DBG] pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:36:59.264 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:36:59.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:58 smithi089 bash[88398]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:59.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:58 smithi089 bash[88398]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:59.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:58 smithi089 bash[91918]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:59.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:58 smithi089 bash[91918]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:58 smithi110 bash[70834]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:36:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:58 smithi110 bash[70834]: audit 2024-09-21T05:36:58.593156+0000 mgr.y (mgr.25142) 619 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:00.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:59 smithi089 bash[88398]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:36:59 smithi089 bash[88398]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:59 smithi089 bash[91918]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:36:59 smithi089 bash[91918]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:59 smithi110 bash[70834]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:36:59 smithi110 bash[70834]: cluster 2024-09-21T05:36:58.925643+0000 mgr.y (mgr.25142) 620 : cluster [DBG] pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:00.876 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:37:01.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:01 smithi089 bash[88398]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:01 smithi089 bash[88398]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:01 smithi089 bash[91918]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:01 smithi089 bash[91918]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:01.04994505Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:01 smithi110 bash[70834]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:01 smithi110 bash[70834]: audit 2024-09-21T05:37:00.877262+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.15.89:0/4074420786' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:37:01.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd' 2024-09-21T05:37:02.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:02 smithi089 bash[88398]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:02.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:02 smithi089 bash[88398]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:02.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:02 smithi089 bash[91918]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:02.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:02 smithi089 bash[91918]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:02 smithi110 bash[70834]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:02 smithi110 bash[70834]: cluster 2024-09-21T05:37:00.926347+0000 mgr.y (mgr.25142) 621 : cluster [DBG] pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:04.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:04 smithi089 bash[88398]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:04.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:04 smithi089 bash[88398]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:04.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:04 smithi089 bash[91918]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:04.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:04 smithi089 bash[91918]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:04.041140371Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:04 smithi110 bash[70834]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:04 smithi110 bash[70834]: cluster 2024-09-21T05:37:02.927310+0000 mgr.y (mgr.25142) 622 : cluster [DBG] pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:06] "GET /metrics HTTP/1.1" 200 38346 "" "Prometheus/2.51.0" 2024-09-21T05:37:06.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[91918]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[91918]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[91918]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[91918]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[88398]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[88398]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[88398]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:06 smithi089 bash[88398]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:06 smithi110 bash[70834]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:06 smithi110 bash[70834]: cluster 2024-09-21T05:37:04.928186+0000 mgr.y (mgr.25142) 623 : cluster [DBG] pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:06 smithi110 bash[70834]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:06 smithi110 bash[70834]: audit 2024-09-21T05:37:05.465480+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:06.468 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:37:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:07.048726723Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:08.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:08 smithi089 bash[88398]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:08.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:08 smithi089 bash[88398]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:08.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:08 smithi089 bash[91918]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:08.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:08 smithi089 bash[91918]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:08 smithi110 bash[70834]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:08.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:08 smithi110 bash[70834]: cluster 2024-09-21T05:37:06.929689+0000 mgr.y (mgr.25142) 624 : cluster [DBG] pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:09.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[88398]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[88398]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[88398]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:09.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[88398]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:09.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[91918]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[91918]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[91918]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:09.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:09 smithi089 bash[91918]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:09 smithi110 bash[70834]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:09 smithi110 bash[70834]: audit 2024-09-21T05:37:07.984873+0000 mgr.y (mgr.25142) 625 : audit [DBG] from='client.54368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:09 smithi110 bash[70834]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:09.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:09 smithi110 bash[70834]: audit 2024-09-21T05:37:08.602164+0000 mgr.y (mgr.25142) 626 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:10.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:10 smithi089 bash[88398]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:10 smithi089 bash[88398]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:10 smithi089 bash[91918]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:10 smithi089 bash[91918]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:10.054970734Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:10 smithi110 bash[70834]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:10 smithi110 bash[70834]: cluster 2024-09-21T05:37:08.930693+0000 mgr.y (mgr.25142) 627 : cluster [DBG] pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:10.585 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:11.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:37:11.957 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:11.957 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:11.957 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[88398]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:11.958 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:11.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:11 smithi089 bash[91918]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: cephadm 2024-09-21T05:37:10.577160+0000 mgr.y (mgr.25142) 628 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:12.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:10.585250+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.330429+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.332491+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:12.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:11 smithi110 bash[70834]: audit 2024-09-21T05:37:11.340955+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[88398]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[88398]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[88398]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[88398]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[91918]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[91918]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[91918]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:12 smithi089 bash[91918]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:12 smithi110 bash[70834]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:12 smithi110 bash[70834]: cluster 2024-09-21T05:37:10.931656+0000 mgr.y (mgr.25142) 629 : cluster [DBG] pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:12 smithi110 bash[70834]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:12 smithi110 bash[70834]: cephadm 2024-09-21T05:37:11.419077+0000 mgr.y (mgr.25142) 630 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:37:13.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:13.066552116Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[88398]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:14 smithi089 bash[91918]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: cluster 2024-09-21T05:37:12.932136+0000 mgr.y (mgr.25142) 631 : cluster [DBG] pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.949392+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.954772+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.959029+0000 mon.b (mon.1) 203 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.966076+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.973890+0000 mon.b (mon.1) 204 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.980181+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.987255+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:15.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:13.996222+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:15.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:14 smithi110 bash[70834]: audit 2024-09-21T05:37:14.002844+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T05:37:15.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:15.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:15.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:15.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:15.980 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[91918]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:15.981 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:15.982 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:15 smithi089 bash[88398]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:16.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:16.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.952277+0000 mgr.y (mgr.25142) 632 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:37:16.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:16.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.952354+0000 mgr.y (mgr.25142) 633 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:37:16.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.960772+0000 mgr.y (mgr.25142) 634 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.975212+0000 mgr.y (mgr.25142) 635 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:13.988928+0000 mgr.y (mgr.25142) 636 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: audit 2024-09-21T05:37:14.003151+0000 mgr.y (mgr.25142) 637 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:16.023 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:15 smithi110 bash[70834]: cephadm 2024-09-21T05:37:14.005932+0000 mgr.y (mgr.25142) 638 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-09-21T05:37:16.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:16] "GET /metrics HTTP/1.1" 200 38346 "" "Prometheus/2.51.0" 2024-09-21T05:37:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:16.022932337Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:16.944 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:37:17.056 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.141 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[91918]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.142 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:16 smithi089 bash[88398]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: cluster 2024-09-21T05:37:14.932979+0000 mgr.y (mgr.25142) 639 : cluster [DBG] pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:17.143 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.144 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.478427+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:17.144 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.144 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.484576+0000 mon.b (mon.1) 207 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T05:37:17.144 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:17.144 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:16 smithi110 bash[70834]: audit 2024-09-21T05:37:16.486199+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:18.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[88398]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[88398]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[88398]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[88398]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[91918]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[91918]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[91918]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:17 smithi089 bash[91918]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:17 smithi110 bash[70834]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:17 smithi110 bash[70834]: cephadm 2024-09-21T05:37:16.471719+0000 mgr.y (mgr.25142) 640 : cephadm [INF] Upgrade: Updating osd.3 2024-09-21T05:37:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:17 smithi110 bash[70834]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:17 smithi110 bash[70834]: cephadm 2024-09-21T05:37:16.491179+0000 mgr.y (mgr.25142) 641 : cephadm [INF] Deploying daemon osd.3 on smithi089 2024-09-21T05:37:18.863 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:18 smithi089 bash[88398]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:18.863 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:18 smithi089 bash[88398]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:18.863 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:18 smithi089 bash[91918]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:18.863 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:18 smithi089 bash[91918]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:19.036 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:18 smithi110 bash[70834]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:19.036 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:18 smithi110 bash[70834]: cluster 2024-09-21T05:37:16.934447+0000 mgr.y (mgr.25142) 642 : cluster [DBG] pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:19.197 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:37:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:19.037827989Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:19.856 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:37:19.856 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (9m) 76s ago 36m 14.1M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:37:19.856 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (9m) 7m ago 36m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (11m) 76s ago 34m 49.0M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (11m) 7m ago 45m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (22m) 76s ago 47m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (6m) 76s ago 47m 50.0M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (7m) 7m ago 45m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (5m) 76s ago 45m 37.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (10m) 76s ago 37m 8999k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (10m) 7m ago 36m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 76s ago 44m 47.1M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 76s ago 43m 50.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running 76s ago 42m - 3036M 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (41m) 76s ago 41m 63.0M 3036M 19.1.1-373-g4e45e6b4 164465d2334a 36647fbfc2f7 2024-09-21T05:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (40m) 7m ago 40m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (39m) 7m ago 39m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (39m) 7m ago 39m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (38m) 7m ago 38m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (10m) 7m ago 37m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (34m) 76s ago 34m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:37:19.858 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (34m) 7m ago 34m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:37:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:19 smithi089 bash[88398]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:19 smithi089 bash[88398]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:19 smithi089 bash[91918]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:19 smithi089 bash[91918]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:19 smithi110 bash[70834]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:19 smithi110 bash[70834]: audit 2024-09-21T05:37:18.610171+0000 mgr.y (mgr.25142) 643 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:20.213 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:37:20.213 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:37:20.213 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T05:37:20.214 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 8 2024-09-21T05:37:20.215 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:37:20.215 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:37:20.530 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:37:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:37:20.530 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/8 daemons upgraded", 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:37:20.531 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:37:20.959 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[91918]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:20.960 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:20.961 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:20 smithi089 bash[88398]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: cluster 2024-09-21T05:37:18.935120+0000 mgr.y (mgr.25142) 644 : cluster [DBG] pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:19.185773+0000 mgr.y (mgr.25142) 645 : audit [DBG] from='client.54374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:19.503276+0000 mgr.y (mgr.25142) 646 : audit [DBG] from='client.54380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:20.214245+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.15.89:0/2702187314' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:21.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:20 smithi110 bash[70834]: audit 2024-09-21T05:37:20.465306+0000 mon.b (mon.1) 209 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:22.019 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[88398]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.019 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[88398]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.019 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[88398]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.019 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[88398]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.020 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[91918]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.020 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[91918]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.020 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[91918]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.020 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:21 smithi089 bash[91918]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:21 smithi110 bash[70834]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:21 smithi110 bash[70834]: audit 2024-09-21T05:37:19.820305+0000 mgr.y (mgr.25142) 647 : audit [DBG] from='client.44412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:21 smithi110 bash[70834]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:21 smithi110 bash[70834]: audit 2024-09-21T05:37:20.531051+0000 mgr.y (mgr.25142) 648 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:22.298 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.298 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.299 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.299 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.300 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.300 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.300 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:22.300 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:22 smithi089 systemd[1]: Stopping Ceph osd.3 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:37:22.301 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[45692]: debug 2024-09-21T05:37:22.249+0000 7f27b6d1a640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:37:22.301 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[45692]: debug 2024-09-21T05:37:22.249+0000 7f27b6d1a640 -1 osd.3 127 *** Got signal Terminated *** 2024-09-21T05:37:22.301 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[45692]: debug 2024-09-21T05:37:22.249+0000 7f27b6d1a640 -1 osd.3 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:37:22.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:22.065097353Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[88398]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[88398]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[91918]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[91918]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:22 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:22 smithi110 bash[70834]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:22 smithi110 bash[70834]: cluster 2024-09-21T05:37:20.936557+0000 mgr.y (mgr.25142) 649 : cluster [DBG] pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:37:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:22 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:22 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.250982+0000 mon.a (mon.0) 287 : cluster [INF] osd.3 marked itself down and dead 2024-09-21T05:37:24.020 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[112569]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-3 2024-09-21T05:37:24.020 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[112635]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-3 2024-09-21T05:37:24.020 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[88398]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:24.021 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:23 smithi089 bash[91918]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.642422+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.652881+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e128: 8 total, 7 up, 8 in 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:24.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:23 smithi110 bash[70834]: cluster 2024-09-21T05:37:23.655572+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e129: 8 total, 7 up, 8 in 2024-09-21T05:37:25.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:24 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:24 smithi110 bash[70834]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:24 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:24 smithi089 bash[88398]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:24 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:24 smithi089 bash[91918]: cluster 2024-09-21T05:37:22.937309+0000 mgr.y (mgr.25142) 650 : cluster [DBG] pgmap v373: 161 pgs: 27 stale+active+clean, 134 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:37:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:25.042422497Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:25 smithi089 bash[88398]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:25 smithi089 bash[88398]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:25 smithi089 bash[91918]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:25 smithi089 bash[91918]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:25 smithi110 bash[70834]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:25 smithi110 bash[70834]: cluster 2024-09-21T05:37:25.694033+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 14 pgs peering (PG_AVAILABILITY) 2024-09-21T05:37:26.372 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.372 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:26] "GET /metrics HTTP/1.1" 200 38341 "" "Prometheus/2.51.0" 2024-09-21T05:37:26.372 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.372 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.373 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T05:37:26.373 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: Stopped Ceph osd.3 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:37:26.373 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.373 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.373 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.374 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.374 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.374 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:37:26.748 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:26 smithi089 systemd[1]: Started Ceph osd.3 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[88398]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:26 smithi089 bash[91918]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: cluster 2024-09-21T05:37:24.938182+0000 mgr.y (mgr.25142) 651 : cluster [DBG] pgmap v375: 161 pgs: 14 peering, 21 stale+active+clean, 126 active+clean; 585 KiB data, 271 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 0 op/s 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: audit 2024-09-21T05:37:26.418235+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:26 smithi110 bash[70834]: audit 2024-09-21T05:37:26.429857+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:28.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[112783]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:37:28.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[112783]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:37:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[88398]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[88398]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[88398]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[88398]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[91918]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[91918]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[91918]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:27 smithi089 bash[91918]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:28.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:28.050787641Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:27 smithi110 bash[70834]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:27 smithi110 bash[70834]: cluster 2024-09-21T05:37:26.939028+0000 mgr.y (mgr.25142) 652 : cluster [DBG] pgmap v376: 161 pgs: 23 active+undersized, 14 peering, 6 stale+active+clean, 15 active+undersized+degraded, 103 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 47/732 objects degraded (6.421%) 2024-09-21T05:37:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:27 smithi110 bash[70834]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:27 smithi110 bash[70834]: cluster 2024-09-21T05:37:27.748645+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 47/732 objects degraded (6.421%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:28 smithi089 bash[88398]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:28 smithi089 bash[88398]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:29.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:28 smithi089 bash[91918]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:29.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:28 smithi089 bash[91918]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:28 smithi110 bash[70834]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:28 smithi110 bash[70834]: audit 2024-09-21T05:37:28.614181+0000 mgr.y (mgr.25142) 653 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:30.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:29 smithi089 bash[88398]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:30.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:29 smithi089 bash[88398]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:29 smithi089 bash[91918]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:30.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:29 smithi089 bash[91918]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:29 smithi110 bash[70834]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:30.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:29 smithi110 bash[70834]: cluster 2024-09-21T05:37:28.940527+0000 mgr.y (mgr.25142) 654 : cluster [DBG] pgmap v377: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:31.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:30 smithi089 bash[88398]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:31.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:30 smithi089 bash[88398]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:31.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:30 smithi089 bash[91918]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:31.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:30 smithi089 bash[91918]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:31.021974813Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:30 smithi110 bash[70834]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:30 smithi110 bash[70834]: cluster 2024-09-21T05:37:29.803724+0000 mon.a (mon.0) 295 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 14 pgs peering) 2024-09-21T05:37:32.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[88398]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[88398]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[91918]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[91918]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[112783]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:37:32.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[112783]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:37:32.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[112783]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:37:32.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[112783]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T05:37:32.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:31 smithi089 bash[112783]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T05:37:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:31 smithi110 bash[70834]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:31 smithi110 bash[70834]: cluster 2024-09-21T05:37:30.942053+0000 mgr.y (mgr.25142) 655 : cluster [DBG] pgmap v378: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:32.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:32 smithi089 bash[112783]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-09-21T05:37:32.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:32 smithi089 bash[112783]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T05:37:32.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:32 smithi089 bash[112783]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-21T05:37:32.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:32 smithi089 bash[112783]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T05:37:32.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:32 smithi089 bash[112783]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[88398]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[88398]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[88398]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[88398]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[91918]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[91918]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[91918]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:33 smithi089 bash[91918]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:33 smithi110 bash[70834]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:33 smithi110 bash[70834]: audit 2024-09-21T05:37:32.328843+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:33 smithi110 bash[70834]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:33 smithi110 bash[70834]: audit 2024-09-21T05:37:32.340312+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.296 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[113472]: debug 2024-09-21T05:37:34.029+0000 7fce17a23640 1 -- 172.21.15.89:0/3513813186 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ce381a960 con 0x557ce4608000 2024-09-21T05:37:34.403 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:34.058857738Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[88398]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:34 smithi089 bash[91918]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: cluster 2024-09-21T05:37:32.942600+0000 mgr.y (mgr.25142) 656 : cluster [DBG] pgmap v379: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: audit 2024-09-21T05:37:33.404225+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:34 smithi110 bash[70834]: audit 2024-09-21T05:37:33.414449+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:35.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:35 smithi089 bash[88398]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:35.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:35 smithi089 bash[88398]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:35.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:35 smithi089 bash[91918]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:35.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:35 smithi089 bash[91918]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:35 smithi110 bash[70834]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:35 smithi110 bash[70834]: cluster 2024-09-21T05:37:34.420337+0000 mon.a (mon.0) 300 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 25 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:36.196 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:35 smithi089 bash[113472]: debug 2024-09-21T05:37:35.809+0000 7fce1a28a640 -1 Falling back to public interface 2024-09-21T05:37:36.468 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:36] "GET /metrics HTTP/1.1" 200 38348 "" "Prometheus/2.51.0" 2024-09-21T05:37:36.469 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.470 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.470 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.470 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.470 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:36.470 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[91918]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:36 smithi089 bash[88398]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: cluster 2024-09-21T05:37:34.943367+0000 mgr.y (mgr.25142) 657 : cluster [DBG] pgmap v380: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: audit 2024-09-21T05:37:35.472680+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:36 smithi110 bash[70834]: audit 2024-09-21T05:37:35.475303+0000 mon.b (mon.1) 210 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:37.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:37.057176392Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:38 smithi089 bash[88398]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:38 smithi089 bash[88398]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:38.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:38 smithi089 bash[91918]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:38.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:38 smithi089 bash[91918]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:38 smithi110 bash[70834]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:38 smithi110 bash[70834]: cluster 2024-09-21T05:37:36.945106+0000 mgr.y (mgr.25142) 658 : cluster [DBG] pgmap v381: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:37:39.296 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:38 smithi089 bash[113472]: debug 2024-09-21T05:37:38.973+0000 7fce1a28a640 -1 osd.3 127 log_to_monitors true 2024-09-21T05:37:39.738 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[113472]: debug 2024-09-21T05:37:39.513+0000 7fce12034640 -1 osd.3 127 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[88398]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[88398]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[88398]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[88398]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[91918]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[91918]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[91918]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:39.739 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:39 smithi089 bash[91918]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:39 smithi110 bash[70834]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:39 smithi110 bash[70834]: audit 2024-09-21T05:37:38.622062+0000 mgr.y (mgr.25142) 659 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:39 smithi110 bash[70834]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:39 smithi110 bash[70834]: audit 2024-09-21T05:37:38.981213+0000 mon.a (mon.0) 302 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T05:37:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:40.022493545Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[88398]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:40.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:40 smithi089 bash[91918]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: cluster 2024-09-21T05:37:38.945915+0000 mgr.y (mgr.25142) 660 : cluster [DBG] pgmap v382: 161 pgs: 41 active+undersized, 25 active+undersized+degraded, 95 active+clean; 585 KiB data, 275 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: audit 2024-09-21T05:37:39.482563+0000 mon.a (mon.0) 303 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: cluster 2024-09-21T05:37:39.492080+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e130: 8 total, 7 up, 8 in 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:40 smithi110 bash[70834]: audit 2024-09-21T05:37:39.492844+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi089", "root=default"]} : dispatch 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[88398]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:41.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:41 smithi089 bash[91918]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.483778+0000 mon.a (mon.0) 306 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.492905+0000 mon.a (mon.0) 307 : cluster [INF] osd.3 [v2:172.21.15.89:6826/3068606826,v1:172.21.15.89:6827/3068606826] boot 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.493112+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: audit 2024-09-21T05:37:40.495765+0000 mon.b (mon.1) 211 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T05:37:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:41.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:41 smithi110 bash[70834]: cluster 2024-09-21T05:37:41.498237+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[88398]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[88398]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[88398]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[91918]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[91918]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:42.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:42 smithi089 bash[91918]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:42 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:42 smithi110 bash[70834]: cluster 2024-09-21T05:37:40.947222+0000 mgr.y (mgr.25142) 661 : cluster [DBG] pgmap v385: 161 pgs: 23 peering, 27 active+undersized, 16 active+undersized+degraded, 95 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 70/732 objects degraded (9.563%) 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:42 smithi110 bash[70834]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:42 smithi110 bash[70834]: cluster 2024-09-21T05:37:41.501081+0000 mon.a (mon.0) 310 : cluster [WRN] Health check update: Degraded data redundancy: 70/732 objects degraded (9.563%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T05:37:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:43.02269326Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:44.045 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:43 smithi089 bash[68019]: debug 2024-09-21T05:37:43.717+0000 7f1a88244640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:44.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:44.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:44 smithi110 bash[70834]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: cluster 2024-09-21T05:37:42.948408+0000 mgr.y (mgr.25142) 662 : cluster [DBG] pgmap v387: 161 pgs: 23 peering, 22 active+undersized, 13 active+undersized+degraded, 103 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail; 57/732 objects degraded (7.787%) 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.551626+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.564937+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.568556+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.570529+0000 mon.b (mon.1) 213 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.583586+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.709715+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.713256+0000 mon.b (mon.1) 215 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.715830+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.718135+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[88398]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.721018+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:37:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:45.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: audit 2024-09-21T05:37:43.721284+0000 mgr.y (mgr.25142) 663 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:37:45.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:45.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:44 smithi089 bash[91918]: cephadm 2024-09-21T05:37:43.723180+0000 mgr.y (mgr.25142) 664 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T05:37:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[88398]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[88398]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[88398]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[88398]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[91918]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[91918]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[91918]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:45 smithi089 bash[91918]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:45 smithi110 bash[70834]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:45 smithi110 bash[70834]: cluster 2024-09-21T05:37:45.549437+0000 mon.a (mon.0) 314 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 13 pgs degraded) 2024-09-21T05:37:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:45 smithi110 bash[70834]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:45 smithi110 bash[70834]: cluster 2024-09-21T05:37:45.549487+0000 mon.a (mon.0) 315 : cluster [INF] Cluster is now healthy 2024-09-21T05:37:46.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:46] "GET /metrics HTTP/1.1" 200 38348 "" "Prometheus/2.51.0" 2024-09-21T05:37:46.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:46.056608906Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:46 smithi089 bash[88398]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:46 smithi089 bash[88398]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:46 smithi089 bash[91918]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:46 smithi089 bash[91918]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:46 smithi110 bash[70834]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:46 smithi110 bash[70834]: cluster 2024-09-21T05:37:44.949495+0000 mgr.y (mgr.25142) 665 : cluster [DBG] pgmap v388: 161 pgs: 23 peering, 138 active+clean; 585 KiB data, 267 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:48 smithi110 bash[70834]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:48 smithi110 bash[70834]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:48 smithi089 bash[88398]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:48 smithi089 bash[88398]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:48 smithi089 bash[91918]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:48 smithi089 bash[91918]: cluster 2024-09-21T05:37:46.950850+0000 mgr.y (mgr.25142) 666 : cluster [DBG] pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:49.044932026Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:49 smithi089 bash[88398]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:49 smithi089 bash[88398]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:49 smithi089 bash[91918]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:49 smithi089 bash[91918]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:49 smithi110 bash[70834]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:49 smithi110 bash[70834]: audit 2024-09-21T05:37:48.631414+0000 mgr.y (mgr.25142) 667 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:37:50.882 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[91918]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:50 smithi089 bash[88398]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: cluster 2024-09-21T05:37:48.951884+0000 mgr.y (mgr.25142) 668 : cluster [DBG] pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: audit 2024-09-21T05:37:50.475355+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:50 smithi110 bash[70834]: audit 2024-09-21T05:37:50.478154+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (10m) 19s ago 37m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (9m) 7m ago 37m 67.8M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (12m) 19s ago 34m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (11m) 7m ago 45m 441M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (22m) 19s ago 47m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (6m) 19s ago 48m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (7m) 7m ago 46m 18.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (6m) 19s ago 46m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (11m) 19s ago 37m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:37:51.536 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (11m) 7m ago 37m 7908k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 19s ago 45m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 19s ago 44m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (107s) 19s ago 43m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 19s ago 42m - 3036M 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (41m) 7m ago 41m 74.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 199f81285cf3 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (40m) 7m ago 40m 56.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (39m) 7m ago 39m 64.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (38m) 7m ago 38m 65.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (10m) 7m ago 37m 40.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (35m) 19s ago 35m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:37:51.537 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (35m) 7m ago 35m 102M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 4 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:51.891 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 9 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:37:51.892 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:37:52.205 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "3/8 daemons upgraded", 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:37:52.206 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:37:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:52.022754844Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:53.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[91918]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:53.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:52 smithi089 bash[88398]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:50.869710+0000 mgr.y (mgr.25142) 669 : audit [DBG] from='client.44436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: cluster 2024-09-21T05:37:50.952825+0000 mgr.y (mgr.25142) 670 : cluster [DBG] pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.194367+0000 mgr.y (mgr.25142) 671 : audit [DBG] from='client.44442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.500351+0000 mgr.y (mgr.25142) 672 : audit [DBG] from='client.54422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:53.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:52 smithi110 bash[70834]: audit 2024-09-21T05:37:51.891425+0000 mon.c (mon.2) 9 : audit [DBG] from='client.? 172.21.15.89:0/1834629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:37:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:53 smithi089 bash[88398]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:53 smithi089 bash[88398]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:53 smithi089 bash[91918]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:53 smithi089 bash[91918]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:53 smithi110 bash[70834]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:53 smithi110 bash[70834]: audit 2024-09-21T05:37:52.206479+0000 mgr.y (mgr.25142) 673 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:37:55.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:54 smithi110 bash[70834]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.045 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:54 smithi110 bash[70834]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:54 smithi089 bash[88398]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:54 smithi089 bash[88398]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:54 smithi089 bash[91918]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:54 smithi089 bash[91918]: cluster 2024-09-21T05:37:52.953747+0000 mgr.y (mgr.25142) 674 : cluster [DBG] pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T05:37:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:55.045678026Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:56.545 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:37:56] "GET /metrics HTTP/1.1" 200 38341 "" "Prometheus/2.51.0" 2024-09-21T05:37:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[88398]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[88398]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[88398]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[88398]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:57.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[91918]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[91918]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[91918]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:57.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:56 smithi089 bash[91918]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:56 smithi110 bash[70834]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:56 smithi110 bash[70834]: cluster 2024-09-21T05:37:54.954796+0000 mgr.y (mgr.25142) 675 : cluster [DBG] pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-09-21T05:37:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:56 smithi110 bash[70834]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:56 smithi110 bash[70834]: audit 2024-09-21T05:37:55.713064+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:37:58.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:37:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:37:58.053683171Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:37:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:58 smithi089 bash[88398]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:58 smithi089 bash[88398]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:59.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:58 smithi089 bash[91918]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:58 smithi089 bash[91918]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:58 smithi110 bash[70834]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:37:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:58 smithi110 bash[70834]: cluster 2024-09-21T05:37:56.956123+0000 mgr.y (mgr.25142) 676 : cluster [DBG] pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[88398]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:37:59 smithi089 bash[91918]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.642285+0000 mgr.y (mgr.25142) 677 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.738889+0000 mon.b (mon.1) 220 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: audit 2024-09-21T05:37:58.739301+0000 mgr.y (mgr.25142) 678 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:37:59 smithi110 bash[70834]: cephadm 2024-09-21T05:37:58.742319+0000 mgr.y (mgr.25142) 679 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-09-21T05:38:01.036 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:00 smithi110 bash[70834]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.037 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:00 smithi110 bash[70834]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.045 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:00 smithi089 bash[88398]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:00 smithi089 bash[88398]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:00 smithi089 bash[91918]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:00 smithi089 bash[91918]: cluster 2024-09-21T05:37:58.957149+0000 mgr.y (mgr.25142) 680 : cluster [DBG] pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:01.038037453Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[88398]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:02.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:02 smithi089 bash[91918]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cluster 2024-09-21T05:38:00.958636+0000 mgr.y (mgr.25142) 681 : cluster [DBG] pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cephadm 2024-09-21T05:38:01.301455+0000 mgr.y (mgr.25142) 682 : cephadm [INF] Upgrade: Updating osd.4 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.311425+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.315863+0000 mon.b (mon.1) 221 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: audit 2024-09-21T05:38:01.317680+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:02.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:02 smithi110 bash[70834]: cephadm 2024-09-21T05:38:01.322836+0000 mgr.y (mgr.25142) 683 : cephadm [INF] Deploying daemon osd.4 on smithi110 2024-09-21T05:38:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:04.032615066Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:04.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:04 smithi089 bash[88398]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:04.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:04 smithi089 bash[88398]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:04.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:04 smithi089 bash[91918]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:04.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:04 smithi089 bash[91918]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:04 smithi110 bash[70834]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:04 smithi110 bash[70834]: cluster 2024-09-21T05:38:02.959530+0000 mgr.y (mgr.25142) 684 : cluster [DBG] pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:06.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.304 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.305 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: Stopping Ceph osd.4 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:38:06.305 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.306 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.306 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:06] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:38:06.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[88398]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[88398]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[88398]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[88398]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[91918]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[91918]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[91918]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:06 smithi089 bash[91918]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[70834]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[70834]: cluster 2024-09-21T05:38:04.960513+0000 mgr.y (mgr.25142) 685 : cluster [DBG] pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[70834]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[70834]: audit 2024-09-21T05:38:05.466973+0000 mon.b (mon.1) 223 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:06.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[25430]: debug 2024-09-21T05:38:06.381+0000 7fb6fe9af640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:38:06.805 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[25430]: debug 2024-09-21T05:38:06.381+0000 7fb6fe9af640 -1 osd.4 132 *** Got signal Terminated *** 2024-09-21T05:38:06.805 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:06 smithi110 bash[25430]: debug 2024-09-21T05:38:06.381+0000 7fb6fe9af640 -1 osd.4 132 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:38:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:07.046709662Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:07 smithi089 bash[88398]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:07 smithi089 bash[88398]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:07.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:07 smithi089 bash[91918]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:07.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:07 smithi089 bash[91918]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:07 smithi110 bash[70834]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:07.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:07 smithi110 bash[70834]: cluster 2024-09-21T05:38:06.385842+0000 mon.a (mon.0) 319 : cluster [INF] osd.4 marked itself down and dead 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[88398]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:08.653 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.654 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.654 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.654 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.654 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:08.654 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:08 smithi089 bash[91918]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:08.667 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[74452]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-4 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:06.961798+0000 mgr.y (mgr.25142) 686 : cluster [DBG] pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:07.319311+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:08.667 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[70834]: cluster 2024-09-21T05:38:07.346377+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e133: 8 total, 7 up, 8 in 2024-09-21T05:38:09.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:08 smithi110 bash[74513]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-4 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[88398]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[88398]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[88398]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[88398]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[91918]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[91918]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[91918]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:09 smithi089 bash[91918]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:09 smithi110 bash[70834]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:09 smithi110 bash[70834]: cluster 2024-09-21T05:38:08.345904+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e134: 8 total, 7 up, 8 in 2024-09-21T05:38:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:09 smithi110 bash[70834]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:09 smithi110 bash[70834]: audit 2024-09-21T05:38:08.653403+0000 mgr.y (mgr.25142) 687 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:10.139 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:10.043989968Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:10.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 bash[70834]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[88398]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:08.962896+0000 mgr.y (mgr.25142) 688 : cluster [DBG] pgmap v402: 161 pgs: 4 active+undersized, 10 peering, 19 stale+active+clean, 5 active+undersized+degraded, 123 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 27/732 objects degraded (3.689%) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:09.338101+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:10 smithi089 bash[91918]: cluster 2024-09-21T05:38:09.338172+0000 mon.a (mon.0) 324 : cluster [WRN] Health check failed: Degraded data redundancy: 27/732 objects degraded (3.689%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:11.089 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.089 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.089 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.090 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.090 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.091 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T05:38:11.091 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: Stopped Ceph osd.4 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:38:11.091 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.091 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.091 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:38:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:11.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:11 smithi110 systemd[1]: Started Ceph osd.4 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.457 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[70834]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[88398]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: cluster 2024-09-21T05:38:10.964760+0000 mgr.y (mgr.25142) 689 : cluster [DBG] pgmap v403: 161 pgs: 34 active+undersized, 10 peering, 25 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 108/732 objects degraded (14.754%) 2024-09-21T05:38:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: audit 2024-09-21T05:38:11.139334+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:12 smithi089 bash[91918]: audit 2024-09-21T05:38:11.150761+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:12.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[74662]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:12.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[74662]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:13.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[67424]: logger=cleanup t=2024-09-21T05:38:12.834687634Z level=info msg="Completed cleanup jobs" duration=76.614724ms 2024-09-21T05:38:13.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:12 smithi110 bash[67424]: logger=plugins.update.checker t=2024-09-21T05:38:12.898730255Z level=info msg="Update check succeeded" duration=62.579951ms 2024-09-21T05:38:13.193 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:13.039173295Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:13.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:13 smithi089 bash[88398]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:13.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:13 smithi089 bash[88398]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:13.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:13 smithi089 bash[91918]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:13.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:13 smithi089 bash[91918]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:13.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:13 smithi110 bash[70834]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:13.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:13 smithi110 bash[70834]: cluster 2024-09-21T05:38:13.138817+0000 mon.a (mon.0) 327 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-21T05:38:14.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:14 smithi089 bash[88398]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:14.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:14 smithi089 bash[88398]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:14.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:14 smithi089 bash[91918]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:14.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:14 smithi089 bash[91918]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:14 smithi110 bash[70834]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:14.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:14 smithi110 bash[70834]: cluster 2024-09-21T05:38:12.966014+0000 mgr.y (mgr.25142) 690 : cluster [DBG] pgmap v404: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 127/732 objects degraded (17.350%) 2024-09-21T05:38:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:15 smithi089 bash[88398]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:15 smithi089 bash[88398]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:15.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:15 smithi089 bash[91918]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:15.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:15 smithi089 bash[91918]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:15 smithi110 bash[70834]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:15 smithi110 bash[70834]: cluster 2024-09-21T05:38:14.430526+0000 mon.a (mon.0) 328 : cluster [WRN] Health check update: Degraded data redundancy: 127/732 objects degraded (17.350%), 28 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:16.018836166Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[70834]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[70834]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:38:16.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:16.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:16] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:38:16.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:16 smithi089 bash[88398]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:16 smithi089 bash[88398]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:16 smithi089 bash[91918]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:16 smithi089 bash[91918]: cluster 2024-09-21T05:38:14.967442+0000 mgr.y (mgr.25142) 691 : cluster [DBG] pgmap v405: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:16.745 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T05:38:16.745 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T05:38:17.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-09-21T05:38:17.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T05:38:17.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T05:38:17.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T05:38:17.054 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:16 smithi110 bash[74662]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T05:38:18.470 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.470 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.471 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.471 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.471 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.471 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[70834]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[88398]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: cluster 2024-09-21T05:38:16.968994+0000 mgr.y (mgr.25142) 692 : cluster [DBG] pgmap v406: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 212 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: audit 2024-09-21T05:38:17.119760+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:18 smithi089 bash[91918]: audit 2024-09-21T05:38:17.133029+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:18.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:18 smithi110 bash[75364]: debug 2024-09-21T05:38:18.536+0000 7f181f413640 1 -- 172.21.15.110:0/350636070 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557640010960 con 0x557640031c00 2024-09-21T05:38:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.401 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.401 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.401 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.401 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:19.401 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[70834]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:19.401 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:19.050694801Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[88398]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.272749+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.284624+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:19 smithi089 bash[91918]: audit 2024-09-21T05:38:18.658128+0000 mgr.y (mgr.25142) 693 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:20.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:20 smithi089 bash[88398]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:20.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:20 smithi089 bash[88398]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:20 smithi089 bash[91918]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:20 smithi089 bash[91918]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:20.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:20 smithi110 bash[75364]: debug 2024-09-21T05:38:20.056+0000 7f1821c7a640 -1 Falling back to public interface 2024-09-21T05:38:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:20 smithi110 bash[70834]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:20 smithi110 bash[70834]: cluster 2024-09-21T05:38:18.970359+0000 mgr.y (mgr.25142) 694 : cluster [DBG] pgmap v407: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 289 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[88398]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[88398]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[88398]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[88398]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:21.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[91918]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[91918]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[91918]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:21 smithi089 bash[91918]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:21.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:21 smithi110 bash[70834]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:21 smithi110 bash[70834]: audit 2024-09-21T05:38:20.474039+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:21 smithi110 bash[70834]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:21 smithi110 bash[70834]: audit 2024-09-21T05:38:20.477515+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:22.035265961Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:22.551 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:38:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:22 smithi089 bash[91918]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:22 smithi089 bash[91918]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:22 smithi089 bash[88398]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:22 smithi089 bash[88398]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:22 smithi110 bash[70834]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:22 smithi110 bash[70834]: cluster 2024-09-21T05:38:20.971986+0000 mgr.y (mgr.25142) 695 : cluster [DBG] pgmap v408: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (10m) 50s ago 37m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (10m) 6s ago 37m 69.9M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (12m) 50s ago 35m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (12m) 6s ago 46m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (23m) 50s ago 48m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (7m) 50s ago 48m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (8m) 6s ago 46m 45.6M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:38:23.195 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (6m) 50s ago 46m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (11m) 50s ago 38m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (11m) 6s ago 38m 8236k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 50s ago 45m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 50s ago 44m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 50s ago 43m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 50s ago 42m - 3036M 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running 6s ago 41m - 3292M 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (40m) 6s ago 41m 62.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (40m) 6s ago 40m 69.0M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (39m) 6s ago 39m 71.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (11m) 6s ago 38m 54.3M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (35m) 50s ago 35m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:38:23.196 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (35m) 6s ago 35m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:38:23.568 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:38:23.568 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:38:23.568 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:38:23.568 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:23.568 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 4 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 9 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:38:23.569 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:38:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:23 smithi089 bash[91918]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:23 smithi089 bash[91918]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:23 smithi089 bash[88398]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:23 smithi089 bash[88398]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:23 smithi110 bash[75364]: debug 2024-09-21T05:38:23.672+0000 7f1821c7a640 -1 osd.4 132 log_to_monitors true 2024-09-21T05:38:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:23 smithi110 bash[70834]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:23 smithi110 bash[70834]: audit 2024-09-21T05:38:22.538266+0000 mgr.y (mgr.25142) 696 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "3/8 daemons upgraded", 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:38:23.893 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:38:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[88398]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:24 smithi089 bash[91918]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[75364]: debug 2024-09-21T05:38:24.548+0000 7f1819a24640 -1 osd.4 132 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:22.861028+0000 mgr.y (mgr.25142) 697 : audit [DBG] from='client.54446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: cluster 2024-09-21T05:38:22.972640+0000 mgr.y (mgr.25142) 698 : cluster [DBG] pgmap v409: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 251 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.173070+0000 mgr.y (mgr.25142) 699 : audit [DBG] from='client.54452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.568890+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? 172.21.15.89:0/1822313478' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.682645+0000 mon.b (mon.1) 225 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:24.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:24 smithi110 bash[70834]: audit 2024-09-21T05:38:23.682700+0000 mon.a (mon.0) 334 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T05:38:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:25.040881551Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[88398]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:25 smithi089 bash[91918]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:23.893678+0000 mgr.y (mgr.25142) 700 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.494100+0000 mon.a (mon.0) 335 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: cluster 2024-09-21T05:38:24.500945+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e135: 8 total, 7 up, 8 in 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.503244+0000 mon.b (mon.1) 226 : audit [INF] from='osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:25.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:25 smithi110 bash[70834]: audit 2024-09-21T05:38:24.503691+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:38:26.536 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:26] "GET /metrics HTTP/1.1" 200 38346 "" "Prometheus/2.51.0" 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:26.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[88398]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:26.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:26 smithi089 bash[91918]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:24.973897+0000 mgr.y (mgr.25142) 701 : cluster [DBG] pgmap v411: 161 pgs: 41 active+undersized, 28 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 127/732 objects degraded (17.350%) 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.506022+0000 mon.a (mon.0) 338 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: audit 2024-09-21T05:38:25.514619+0000 mon.b (mon.1) 227 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.515762+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 [v2:172.21.15.110:6800/612946622,v1:172.21.15.110:6801/612946622] boot 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:25.515874+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:26 smithi110 bash[70834]: cluster 2024-09-21T05:38:26.516197+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-09-21T05:38:27.907 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:27 smithi110 bash[70834]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:27.907 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:27 smithi110 bash[70834]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:28.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:27 smithi089 bash[91918]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:28.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:27 smithi089 bash[91918]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:27 smithi089 bash[88398]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:27 smithi089 bash[88398]: cluster 2024-09-21T05:38:27.536676+0000 mon.a (mon.0) 342 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:28.0291847Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:29.046 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[68019]: debug 2024-09-21T05:38:28.659+0000 7f1a88244640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[88398]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:28 smithi089 bash[91918]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: cluster 2024-09-21T05:38:26.974815+0000 mgr.y (mgr.25142) 702 : cluster [DBG] pgmap v414: 161 pgs: 27 peering, 25 active+undersized, 17 active+undersized+degraded, 92 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:38:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.493046+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.508857+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.512806+0000 mon.b (mon.1) 228 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.514780+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:28 smithi110 bash[70834]: audit 2024-09-21T05:38:28.525816+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[88398]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:30.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:29 smithi089 bash[91918]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.652591+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:38:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.655974+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.658692+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.661221+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.664342+0000 mon.b (mon.1) 234 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.664444+0000 mgr.y (mgr.25142) 703 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: audit 2024-09-21T05:38:28.666002+0000 mgr.y (mgr.25142) 704 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:30.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:29 smithi110 bash[70834]: cephadm 2024-09-21T05:38:28.666623+0000 mgr.y (mgr.25142) 705 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-21T05:38:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:30 smithi089 bash[88398]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:30 smithi089 bash[88398]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:30 smithi089 bash[91918]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:30 smithi089 bash[91918]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.051 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:30 smithi110 bash[70834]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.051 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:30 smithi110 bash[70834]: cluster 2024-09-21T05:38:28.976036+0000 mgr.y (mgr.25142) 706 : cluster [DBG] pgmap v415: 161 pgs: 27 peering, 15 active+undersized, 12 active+undersized+degraded, 107 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 41/732 objects degraded (5.601%) 2024-09-21T05:38:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:31.052474075Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[88398]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[88398]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[88398]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[88398]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[91918]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[91918]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[91918]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:31 smithi089 bash[91918]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:31 smithi110 bash[70834]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:31 smithi110 bash[70834]: cluster 2024-09-21T05:38:31.605954+0000 mon.a (mon.0) 346 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/732 objects degraded (5.601%), 12 pgs degraded) 2024-09-21T05:38:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:31 smithi110 bash[70834]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:31 smithi110 bash[70834]: cluster 2024-09-21T05:38:31.606002+0000 mon.a (mon.0) 347 : cluster [INF] Cluster is now healthy 2024-09-21T05:38:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:32 smithi089 bash[88398]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:32 smithi089 bash[88398]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:33.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:32 smithi089 bash[91918]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:33.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:32 smithi089 bash[91918]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:32 smithi110 bash[70834]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:32 smithi110 bash[70834]: cluster 2024-09-21T05:38:30.977521+0000 mgr.y (mgr.25142) 707 : cluster [DBG] pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:38:34.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:34.06904111Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:34 smithi089 bash[88398]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:34 smithi089 bash[88398]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:35.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:34 smithi089 bash[91918]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:35.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:34 smithi089 bash[91918]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:34 smithi110 bash[70834]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:34 smithi110 bash[70834]: cluster 2024-09-21T05:38:32.978381+0000 mgr.y (mgr.25142) 708 : cluster [DBG] pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:36.471 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:36] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[88398]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:36 smithi089 bash[91918]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: cluster 2024-09-21T05:38:34.979545+0000 mgr.y (mgr.25142) 709 : cluster [DBG] pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: audit 2024-09-21T05:38:35.473778+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:36 smithi110 bash[70834]: audit 2024-09-21T05:38:35.477627+0000 mon.b (mon.1) 235 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:37.036468927Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:38 smithi089 bash[88398]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:38.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:38 smithi089 bash[88398]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:38 smithi089 bash[91918]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:38.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:38 smithi089 bash[91918]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:38 smithi110 bash[70834]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:38.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:38 smithi110 bash[70834]: cluster 2024-09-21T05:38:36.980755+0000 mgr.y (mgr.25142) 710 : cluster [DBG] pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 978 B/s rd, 0 op/s 2024-09-21T05:38:39.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:39 smithi089 bash[88398]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:39.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:39 smithi089 bash[88398]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:39.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:39 smithi089 bash[91918]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:39.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:39 smithi089 bash[91918]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:39 smithi110 bash[70834]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:39 smithi110 bash[70834]: audit 2024-09-21T05:38:38.677036+0000 mgr.y (mgr.25142) 711 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:40.041377664Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:40 smithi089 bash[88398]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:40.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:40 smithi089 bash[88398]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:40 smithi089 bash[91918]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:40.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:40 smithi089 bash[91918]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:40 smithi110 bash[70834]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:40.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:40 smithi110 bash[70834]: cluster 2024-09-21T05:38:38.981920+0000 mgr.y (mgr.25142) 712 : cluster [DBG] pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:42.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:41 smithi089 bash[88398]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:42.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:41 smithi089 bash[88398]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:42.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:41 smithi089 bash[91918]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:42.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:41 smithi089 bash[91918]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:41 smithi110 bash[70834]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:42.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:41 smithi110 bash[70834]: audit 2024-09-21T05:38:40.746105+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:43.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:42 smithi110 bash[70834]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:42 smithi110 bash[70834]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:42 smithi089 bash[91918]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:42 smithi089 bash[91918]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:42 smithi089 bash[88398]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:42 smithi089 bash[88398]: cluster 2024-09-21T05:38:40.983419+0000 mgr.y (mgr.25142) 713 : cluster [DBG] pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:43.040599774Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:43 smithi089 bash[88398]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:43 smithi089 bash[88398]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:44.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:43 smithi089 bash[91918]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:44.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:43 smithi089 bash[91918]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:43 smithi110 bash[70834]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:43 smithi110 bash[70834]: audit 2024-09-21T05:38:43.675066+0000 mon.b (mon.1) 236 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T05:38:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[88398]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:44 smithi089 bash[91918]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: cluster 2024-09-21T05:38:42.984333+0000 mgr.y (mgr.25142) 714 : cluster [DBG] pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: audit 2024-09-21T05:38:43.675190+0000 mgr.y (mgr.25142) 715 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:44 smithi110 bash[70834]: cephadm 2024-09-21T05:38:43.678404+0000 mgr.y (mgr.25142) 716 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-09-21T05:38:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:46.025582067Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:46] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[88398]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:47.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:46 smithi089 bash[91918]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cluster 2024-09-21T05:38:44.985573+0000 mgr.y (mgr.25142) 717 : cluster [DBG] pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cephadm 2024-09-21T05:38:46.100610+0000 mgr.y (mgr.25142) 718 : cephadm [INF] Upgrade: Updating osd.5 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.108635+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.114321+0000 mon.b (mon.1) 237 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: audit 2024-09-21T05:38:46.116584+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:47.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:46 smithi110 bash[70834]: cephadm 2024-09-21T05:38:46.121841+0000 mgr.y (mgr.25142) 719 : cephadm [INF] Deploying daemon osd.5 on smithi110 2024-09-21T05:38:48.031 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:47 smithi110 bash[70834]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:48.031 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:47 smithi110 bash[70834]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:47 smithi089 bash[91918]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:48.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:47 smithi089 bash[91918]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:48.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:47 smithi089 bash[88398]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:48.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:47 smithi089 bash[88398]: cluster 2024-09-21T05:38:46.986730+0000 mgr.y (mgr.25142) 720 : cluster [DBG] pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:49.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:48 smithi110 bash[70834]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:48 smithi110 bash[70834]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:48 smithi089 bash[88398]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:48 smithi089 bash[88398]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:48 smithi089 bash[91918]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:48 smithi089 bash[91918]: audit 2024-09-21T05:38:48.686229+0000 mgr.y (mgr.25142) 721 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:49.041610806Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:49 smithi089 bash[88398]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:49 smithi089 bash[88398]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:49 smithi089 bash[91918]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:50.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:49 smithi089 bash[91918]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:49 smithi110 bash[70834]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:50.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:49 smithi110 bash[70834]: cluster 2024-09-21T05:38:48.987781+0000 mgr.y (mgr.25142) 722 : cluster [DBG] pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:38:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:50 smithi089 bash[88398]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:50 smithi089 bash[88398]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:50 smithi089 bash[91918]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:50 smithi089 bash[91918]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:50 smithi110 bash[70834]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:50 smithi110 bash[70834]: audit 2024-09-21T05:38:50.468339+0000 mon.b (mon.1) 239 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.554 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.555 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.555 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.555 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.555 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.555 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:51 smithi110 systemd[1]: Stopping Ceph osd.5 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[30671]: debug 2024-09-21T05:38:51.376+0000 7fb617276640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[30671]: debug 2024-09-21T05:38:51.376+0000 7fb617276640 -1 osd.5 137 *** Got signal Terminated *** 2024-09-21T05:38:51.556 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[30671]: debug 2024-09-21T05:38:51.376+0000 7fb617276640 -1 osd.5 137 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:38:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[88398]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[88398]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[91918]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[91918]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:51 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:52.041098079Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[70834]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[70834]: cluster 2024-09-21T05:38:50.989280+0000 mgr.y (mgr.25142) 723 : cluster [DBG] pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:38:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:51 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.381701+0000 mon.a (mon.0) 351 : cluster [INF] osd.5 marked itself down and dead 2024-09-21T05:38:53.108 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[78801]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-5 2024-09-21T05:38:53.108 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.109 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.109 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.109 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:52 smithi110 bash[70834]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[88398]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.794599+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:38:53.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:52 smithi089 bash[91918]: cluster 2024-09-21T05:38:51.815042+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e138: 8 total, 7 up, 8 in 2024-09-21T05:38:53.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:53 smithi110 bash[78867]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-5 2024-09-21T05:38:54.193 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:53 smithi110 bash[70834]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.193 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:53 smithi110 bash[70834]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.193 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:53 smithi110 bash[70834]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.193 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:53 smithi110 bash[70834]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.234 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:38:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[88398]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[88398]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[88398]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[88398]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[91918]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[91918]: cluster 2024-09-21T05:38:52.828033+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e139: 8 total, 7 up, 8 in 2024-09-21T05:38:54.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[91918]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:53 smithi089 bash[91918]: cluster 2024-09-21T05:38:52.990180+0000 mgr.y (mgr.25142) 724 : cluster [DBG] pgmap v429: 161 pgs: 13 peering, 16 stale+active+clean, 132 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (11m) 82s ago 38m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (10m) 37s ago 38m 69.9M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (13m) 82s ago 35m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (12m) 37s ago 46m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (23m) 82s ago 49m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (7m) 82s ago 49m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:38:54.874 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (9m) 37s ago 47m 45.6M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (7m) 82s ago 47m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (12m) 82s ago 38m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (12m) 37s ago 38m 8236k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 82s ago 46m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 82s ago 45m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 82s ago 44m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 82s ago 43m - 3036M 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running 37s ago 42m - 3292M 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (41m) 37s ago 41m 62.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 0d056ca6a062 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (40m) 37s ago 40m 69.0M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (39m) 37s ago 39m 71.1M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (11m) 37s ago 38m 54.3M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (36m) 82s ago 36m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:38:54.875 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (36m) 37s ago 36m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:38:55.159 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.160 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:54 smithi110 bash[70834]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.160 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:55.050256327Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:55.240 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:38:55.240 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:38:55.240 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:38:55.241 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 5 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:38:55.242 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T05:38:55.243 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 10 2024-09-21T05:38:55.243 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:38:55.243 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:38:55.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[88398]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: cluster 2024-09-21T05:38:53.818577+0000 mon.a (mon.0) 355 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: audit 2024-09-21T05:38:54.222657+0000 mgr.y (mgr.25142) 725 : audit [DBG] from='client.54473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:54 smithi089 bash[91918]: audit 2024-09-21T05:38:54.544445+0000 mgr.y (mgr.25142) 726 : audit [DBG] from='client.54479 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:55.438 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.438 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: Stopped Ceph osd.5 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: Started Ceph osd.5 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:38:55.439 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.440 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.440 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.440 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.440 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:55 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:38:55.563 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:38:55.563 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:38:55.563 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "3/8 daemons upgraded", 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:38:55.564 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:38:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.196 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[91918]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.197 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.198 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:55 smithi089 bash[88398]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:54.854200+0000 mgr.y (mgr.25142) 727 : audit [DBG] from='client.44511 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: cluster 2024-09-21T05:38:54.990896+0000 mgr.y (mgr.25142) 728 : cluster [DBG] pgmap v430: 161 pgs: 15 active+undersized, 13 peering, 6 stale+active+clean, 11 active+undersized+degraded, 116 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 49/732 objects degraded (6.694%) 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.240728+0000 mon.a (mon.0) 356 : audit [DBG] from='client.? 172.21.15.89:0/429085233' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.487334+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.498743+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:55 smithi110 bash[70834]: audit 2024-09-21T05:38:55.564249+0000 mgr.y (mgr.25142) 729 : audit [DBG] from='client.44523 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:38:56.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:38:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:38:56] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:38:57.054 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:56 smithi110 bash[79015]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:57.054 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:38:56 smithi110 bash[79015]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:38:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:56 smithi110 bash[70834]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:56 smithi110 bash[70834]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:57.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:56 smithi089 bash[88398]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:57.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:56 smithi089 bash[88398]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:57.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:56 smithi089 bash[91918]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:57.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:56 smithi089 bash[91918]: cluster 2024-09-21T05:38:55.831133+0000 mon.a (mon.0) 359 : cluster [WRN] Health check failed: Degraded data redundancy: 49/732 objects degraded (6.694%), 11 pgs degraded (PG_DEGRADED) 2024-09-21T05:38:58.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:57 smithi089 bash[88398]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:58.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:57 smithi089 bash[88398]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:58.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:57 smithi089 bash[91918]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:58.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:57 smithi089 bash[91918]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:38:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:38:58.017705936Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:38:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:57 smithi110 bash[70834]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:58.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:57 smithi110 bash[70834]: cluster 2024-09-21T05:38:56.992316+0000 mgr.y (mgr.25142) 730 : cluster [DBG] pgmap v431: 161 pgs: 26 active+undersized, 13 peering, 20 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 71/732 objects degraded (9.699%) 2024-09-21T05:38:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:58 smithi089 bash[88398]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:58 smithi089 bash[88398]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:59.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:58 smithi089 bash[91918]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:59.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:58 smithi089 bash[91918]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:58 smithi110 bash[70834]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:38:59.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:58 smithi110 bash[70834]: audit 2024-09-21T05:38:58.694133+0000 mgr.y (mgr.25142) 731 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:00.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:59 smithi089 bash[88398]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:00.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:38:59 smithi089 bash[88398]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:00.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:59 smithi089 bash[91918]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:00.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:38:59 smithi089 bash[91918]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:00.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:59 smithi110 bash[70834]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:00.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:38:59 smithi110 bash[70834]: cluster 2024-09-21T05:38:58.993645+0000 mgr.y (mgr.25142) 732 : cluster [DBG] pgmap v432: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:01.033 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[70834]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.033 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[70834]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.033 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[79015]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:39:01.034 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[79015]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:01.034 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[79015]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:01.034 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[79015]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T05:39:01.034 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:00 smithi110 bash[79015]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T05:39:01.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:00 smithi089 bash[91918]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:00 smithi089 bash[91918]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:00 smithi089 bash[88398]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:00 smithi089 bash[88398]: cluster 2024-09-21T05:38:59.854291+0000 mon.a (mon.0) 360 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 5 pgs peering) 2024-09-21T05:39:01.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:01.035075759Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:01.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[79015]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-09-21T05:39:01.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[79015]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T05:39:01.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[79015]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T05:39:01.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[79015]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T05:39:01.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:01 smithi110 bash[79015]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T05:39:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[88398]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:02 smithi089 bash[91918]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: cluster 2024-09-21T05:39:00.995318+0000 mgr.y (mgr.25142) 733 : cluster [DBG] pgmap v433: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: audit 2024-09-21T05:39:01.479033+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:02 smithi110 bash[70834]: audit 2024-09-21T05:39:01.490717+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:03.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:03 smithi110 bash[79698]: debug 2024-09-21T05:39:02.996+0000 7f1caeb98640 1 -- 172.21.15.110:0/4244903534 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558cee14c960 con 0x558cee16dc00 2024-09-21T05:39:04.032 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:03 smithi110 bash[70834]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.033 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:03 smithi110 bash[70834]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.033 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:03 smithi110 bash[70834]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.033 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:03 smithi110 bash[70834]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[88398]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[88398]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[88398]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[88398]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[91918]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[91918]: audit 2024-09-21T05:39:02.638558+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[91918]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:03 smithi089 bash[91918]: audit 2024-09-21T05:39:02.650870+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:04.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[79698]: debug 2024-09-21T05:39:04.268+0000 7f1cb13ff640 -1 Falling back to public interface 2024-09-21T05:39:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:04.033979506Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[88398]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[88398]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[88398]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[88398]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[91918]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[91918]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[91918]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:04 smithi089 bash[91918]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[70834]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[70834]: cluster 2024-09-21T05:39:02.996462+0000 mgr.y (mgr.25142) 734 : cluster [DBG] pgmap v434: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[70834]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:04 smithi110 bash[70834]: cluster 2024-09-21T05:39:04.441620+0000 mon.a (mon.0) 365 : cluster [WRN] Health check update: Degraded data redundancy: 82/732 objects degraded (11.202%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:06.472 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:06] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:39:06.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[91918]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:06 smithi089 bash[88398]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: cluster 2024-09-21T05:39:04.997972+0000 mgr.y (mgr.25142) 735 : cluster [DBG] pgmap v435: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: audit 2024-09-21T05:39:05.477652+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:06 smithi110 bash[70834]: audit 2024-09-21T05:39:05.480615+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:07.036810479Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:08.054 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:07 smithi110 bash[79698]: debug 2024-09-21T05:39:07.703+0000 7f1cb13ff640 -1 osd.5 137 log_to_monitors true 2024-09-21T05:39:08.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[91918]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:08 smithi089 bash[88398]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: cluster 2024-09-21T05:39:06.999314+0000 mgr.y (mgr.25142) 736 : cluster [DBG] pgmap v436: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 82/732 objects degraded (11.202%) 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: audit 2024-09-21T05:39:07.711396+0000 mon.b (mon.1) 241 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[70834]: audit 2024-09-21T05:39:07.711487+0000 mon.a (mon.0) 367 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T05:39:09.084 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:08 smithi110 bash[79698]: debug 2024-09-21T05:39:08.811+0000 7f1ca51a1640 -1 osd.5 137 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:39:09.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:09.744 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:09 smithi110 bash[70834]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[88398]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.487973+0000 mon.a (mon.0) 368 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: cluster 2024-09-21T05:39:08.495139+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e140: 8 total, 7 up, 8 in 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.496443+0000 mon.b (mon.1) 242 : audit [INF] from='osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.497901+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.705246+0000 mgr.y (mgr.25142) 737 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:09.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:09 smithi089 bash[91918]: audit 2024-09-21T05:39:08.805349+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-21T05:39:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:10.023710126Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[88398]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:10.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:10 smithi089 bash[91918]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.000501+0000 mgr.y (mgr.25142) 738 : cluster [DBG] pgmap v438: 161 pgs: 38 active+undersized, 21 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 82/732 objects degraded (11.202%) 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.801827+0000 mon.a (mon.0) 372 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.812116+0000 mon.a (mon.0) 373 : cluster [INF] osd.5 [v2:172.21.15.110:6808/3162135087,v1:172.21.15.110:6809/3162135087] boot 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: cluster 2024-09-21T05:39:09.812281+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-09-21T05:39:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:10.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:10 smithi110 bash[70834]: audit 2024-09-21T05:39:09.813091+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T05:39:12.175 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:11 smithi110 bash[70834]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.175 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:11 smithi110 bash[70834]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.175 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:11 smithi110 bash[70834]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:12.176 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:11 smithi110 bash[70834]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[88398]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[88398]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[88398]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[88398]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[91918]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[91918]: cluster 2024-09-21T05:39:10.815189+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-09-21T05:39:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[91918]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:11 smithi089 bash[91918]: cluster 2024-09-21T05:39:11.001431+0000 mgr.y (mgr.25142) 739 : cluster [DBG] pgmap v441: 161 pgs: 14 peering, 30 active+undersized, 15 active+undersized+degraded, 102 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 68/732 objects degraded (9.290%) 2024-09-21T05:39:13.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[68019]: debug 2024-09-21T05:39:13.006+0000 7f1a88244640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:12 smithi089 bash[88398]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:12 smithi089 bash[88398]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:12 smithi089 bash[91918]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:12 smithi089 bash[91918]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:13.021290587Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:12 smithi110 bash[70834]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:12 smithi110 bash[70834]: cluster 2024-09-21T05:39:11.808861+0000 mon.a (mon.0) 376 : cluster [WRN] Health check update: Degraded data redundancy: 68/732 objects degraded (9.290%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.300 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[88398]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:14.302 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:13 smithi089 bash[91918]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.839924+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.864929+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.868906+0000 mon.b (mon.1) 244 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.870564+0000 mon.b (mon.1) 245 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.879839+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:12.997165+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.000806+0000 mon.b (mon.1) 247 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: cluster 2024-09-21T05:39:13.002452+0000 mgr.y (mgr.25142) 740 : cluster [DBG] pgmap v442: 161 pgs: 14 peering, 23 active+undersized, 14 active+undersized+degraded, 110 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 57/732 objects degraded (7.787%) 2024-09-21T05:39:14.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.003617+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.006368+0000 mon.b (mon.1) 249 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.010164+0000 mgr.y (mgr.25142) 741 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: audit 2024-09-21T05:39:13.010316+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:14.306 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:13 smithi110 bash[70834]: cephadm 2024-09-21T05:39:13.011927+0000 mgr.y (mgr.25142) 742 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-09-21T05:39:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:15.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:15.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:15.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:15 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:15 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:15 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.055995+0000 mon.a (mon.0) 380 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 57/732 objects degraded (7.787%), 14 pgs degraded) 2024-09-21T05:39:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:15 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:15.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:15 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.056050+0000 mon.a (mon.0) 381 : cluster [INF] Cluster is now healthy 2024-09-21T05:39:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:16] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:39:16.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:16 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:16.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:16 smithi089 bash[88398]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:16 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:16.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:16 smithi089 bash[91918]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:16.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:16.063260054Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:16 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:16.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:16 smithi110 bash[70834]: cluster 2024-09-21T05:39:15.003786+0000 mgr.y (mgr.25142) 743 : cluster [DBG] pgmap v443: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:18 smithi089 bash[88398]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:18.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:18 smithi089 bash[88398]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:18.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:18 smithi089 bash[91918]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:18.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:18 smithi089 bash[91918]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:18 smithi110 bash[70834]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:18.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:18 smithi110 bash[70834]: cluster 2024-09-21T05:39:17.004871+0000 mgr.y (mgr.25142) 744 : cluster [DBG] pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:19.025782702Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:19 smithi110 bash[70834]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:19.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:19 smithi110 bash[70834]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:19 smithi089 bash[88398]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:19.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:19 smithi089 bash[88398]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:19.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:19 smithi089 bash[91918]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:19.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:19 smithi089 bash[91918]: audit 2024-09-21T05:39:18.714149+0000 mgr.y (mgr.25142) 745 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:20.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:20 smithi089 bash[88398]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:20.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:20 smithi089 bash[88398]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:20 smithi089 bash[91918]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:20.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:20 smithi089 bash[91918]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:20 smithi110 bash[70834]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:20.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:20 smithi110 bash[70834]: cluster 2024-09-21T05:39:19.006100+0000 mgr.y (mgr.25142) 746 : cluster [DBG] pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 333 B/s rd, 0 op/s 2024-09-21T05:39:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[88398]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[88398]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[88398]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:21.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[88398]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[91918]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[91918]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[91918]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:21.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:21 smithi089 bash[91918]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:21 smithi110 bash[70834]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:21 smithi110 bash[70834]: audit 2024-09-21T05:39:20.475896+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:21 smithi110 bash[70834]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:21.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:21 smithi110 bash[70834]: audit 2024-09-21T05:39:20.479192+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:22.039849019Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:22 smithi089 bash[88398]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:22.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:22 smithi089 bash[88398]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:22 smithi089 bash[91918]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:22 smithi089 bash[91918]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:22 smithi110 bash[70834]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:22 smithi110 bash[70834]: cluster 2024-09-21T05:39:21.007415+0000 mgr.y (mgr.25142) 747 : cluster [DBG] pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 803 B/s rd, 0 op/s 2024-09-21T05:39:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:24 smithi089 bash[88398]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:24 smithi089 bash[88398]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:24.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:24 smithi089 bash[91918]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:24 smithi089 bash[91918]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:24 smithi110 bash[70834]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:24 smithi110 bash[70834]: cluster 2024-09-21T05:39:23.008298+0000 mgr.y (mgr.25142) 748 : cluster [DBG] pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-09-21T05:39:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:25.04347422Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:25.911 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:39:26.527 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:39:26.527 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (11m) 114s ago 38m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:39:26.527 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (11m) 25s ago 38m 69.9M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:39:26.527 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (13m) 114s ago 36m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:39:26.527 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (13m) 25s ago 47m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (24m) 114s ago 49m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (8m) 114s ago 49m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (9m) 25s ago 47m 47.5M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (7m) 114s ago 47m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (13m) 114s ago 39m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (12m) 25s ago 39m 8424k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 114s ago 46m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 114s ago 45m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 114s ago 44m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 114s ago 43m - 3036M 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (69s) 25s ago 42m 50.3M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running 25s ago 42m - 3292M 2024-09-21T05:39:26.528 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (41m) 25s ago 41m 69.6M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 6016bd7937b2 2024-09-21T05:39:26.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (40m) 25s ago 40m 72.7M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:39:26.529 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (12m) 25s ago 39m 54.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:39:26.529 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (36m) 114s ago 36m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:39:26.529 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (36m) 25s ago 36m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:39:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:26] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:39:26.907 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 6 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:26.908 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:39:26.909 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T05:39:26.909 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 11 2024-09-21T05:39:26.909 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:39:26.909 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:39:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[91918]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[91918]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[91918]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[91918]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[88398]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[88398]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[88398]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:26 smithi089 bash[88398]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:26 smithi110 bash[70834]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:26 smithi110 bash[70834]: cluster 2024-09-21T05:39:25.009783+0000 mgr.y (mgr.25142) 749 : cluster [DBG] pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T05:39:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:26 smithi110 bash[70834]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:26 smithi110 bash[70834]: audit 2024-09-21T05:39:25.773663+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "4/8 daemons upgraded", 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:39:27.227 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:39:28.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[88398]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:27 smithi089 bash[91918]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:25.898698+0000 mgr.y (mgr.25142) 750 : audit [DBG] from='client.54503 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.217567+0000 mgr.y (mgr.25142) 751 : audit [DBG] from='client.54509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.510606+0000 mgr.y (mgr.25142) 752 : audit [DBG] from='client.54515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:28.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:27 smithi110 bash[70834]: audit 2024-09-21T05:39:26.907888+0000 mon.a (mon.0) 384 : audit [DBG] from='client.? 172.21.15.89:0/1779978441' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:28.553 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:28.075696556Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[88398]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:29.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:28 smithi089 bash[91918]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: cluster 2024-09-21T05:39:27.010402+0000 mgr.y (mgr.25142) 753 : cluster [DBG] pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:27.227374+0000 mgr.y (mgr.25142) 754 : audit [DBG] from='client.54527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.022543+0000 mgr.y (mgr.25142) 755 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-09-21T05:39:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.022596+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16} : dispatch 2024-09-21T05:39:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: cephadm 2024-09-21T05:39:28.025349+0000 mgr.y (mgr.25142) 756 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-09-21T05:39:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:29.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:28 smithi110 bash[70834]: audit 2024-09-21T05:39:28.722183+0000 mgr.y (mgr.25142) 757 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:30.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:29 smithi089 bash[88398]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:30.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:29 smithi089 bash[88398]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:29 smithi089 bash[91918]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:29 smithi089 bash[91918]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:29 smithi110 bash[70834]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:29 smithi110 bash[70834]: cluster 2024-09-21T05:39:29.011525+0000 mgr.y (mgr.25142) 758 : cluster [DBG] pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:31.029200353Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[88398]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:32.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:31 smithi089 bash[91918]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: cephadm 2024-09-21T05:39:30.624365+0000 mgr.y (mgr.25142) 759 : cephadm [INF] Upgrade: Updating osd.6 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.632693+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.638892+0000 mon.b (mon.1) 253 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: audit 2024-09-21T05:39:30.640715+0000 mon.b (mon.1) 254 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:32.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:31 smithi110 bash[70834]: cephadm 2024-09-21T05:39:30.645878+0000 mgr.y (mgr.25142) 760 : cephadm [INF] Deploying daemon osd.6 on smithi110 2024-09-21T05:39:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:32 smithi089 bash[88398]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:33.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:32 smithi089 bash[88398]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:33.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:32 smithi089 bash[91918]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:33.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:32 smithi089 bash[91918]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:32 smithi110 bash[70834]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:33.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:32 smithi110 bash[70834]: cluster 2024-09-21T05:39:31.012952+0000 mgr.y (mgr.25142) 761 : cluster [DBG] pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:34.330 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:34.060108037Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:34 smithi089 bash[88398]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:34 smithi089 bash[88398]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:34 smithi089 bash[91918]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:34 smithi089 bash[91918]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:34 smithi110 bash[70834]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:34 smithi110 bash[70834]: cluster 2024-09-21T05:39:33.014013+0000 mgr.y (mgr.25142) 762 : cluster [DBG] pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:39:35.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:35 smithi110 bash[70834]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:35.735 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:35 smithi110 bash[70834]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:35.736 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.736 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.736 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.737 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.737 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.737 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.737 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:35.738 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:35 smithi089 bash[88398]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:36.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:35 smithi089 bash[88398]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:36.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:35 smithi089 bash[91918]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:36.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:35 smithi089 bash[91918]: audit 2024-09-21T05:39:35.469844+0000 mon.b (mon.1) 255 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:36.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:35 smithi110 systemd[1]: Stopping Ceph osd.6 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:39:36.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:35 smithi110 bash[36295]: debug 2024-09-21T05:39:35.839+0000 7f8eb7606640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:39:36.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:35 smithi110 bash[36295]: debug 2024-09-21T05:39:35.839+0000 7f8eb7606640 -1 osd.6 142 *** Got signal Terminated *** 2024-09-21T05:39:36.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:35 smithi110 bash[36295]: debug 2024-09-21T05:39:35.839+0000 7f8eb7606640 -1 osd.6 142 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:39:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:36] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:39:37.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:36 smithi110 bash[70834]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:36 smithi110 bash[70834]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:36 smithi110 bash[70834]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.019 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:36 smithi110 bash[70834]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[88398]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[88398]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[88398]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[88398]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[91918]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[91918]: cluster 2024-09-21T05:39:35.015441+0000 mgr.y (mgr.25142) 763 : cluster [DBG] pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:39:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[91918]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:36 smithi089 bash[91918]: cluster 2024-09-21T05:39:35.840353+0000 mon.a (mon.0) 386 : cluster [INF] osd.6 marked itself down and dead 2024-09-21T05:39:37.303 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:37.020736304Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:38.017 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[83286]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-6 2024-09-21T05:39:38.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[70834]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[70834]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[70834]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.018 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:37 smithi110 bash[70834]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[88398]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[88398]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[88398]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[88398]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[91918]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[91918]: cluster 2024-09-21T05:39:36.656475+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:39:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[91918]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:37 smithi089 bash[91918]: cluster 2024-09-21T05:39:36.665934+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e143: 8 total, 7 up, 8 in 2024-09-21T05:39:38.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:38 smithi110 bash[83351]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-6 2024-09-21T05:39:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[88398]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[88398]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[88398]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:39.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[88398]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[91918]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[91918]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[91918]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:39.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:38 smithi089 bash[91918]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:38 smithi110 bash[70834]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:38 smithi110 bash[70834]: cluster 2024-09-21T05:39:37.016203+0000 mgr.y (mgr.25142) 764 : cluster [DBG] pgmap v455: 161 pgs: 13 stale+active+clean, 148 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:39:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:38 smithi110 bash[70834]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:38 smithi110 bash[70834]: cluster 2024-09-21T05:39:37.691072+0000 mon.a (mon.0) 389 : cluster [DBG] osdmap e144: 8 total, 7 up, 8 in 2024-09-21T05:39:40.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:39 smithi110 bash[70834]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:39 smithi110 bash[70834]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:39 smithi089 bash[88398]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:39 smithi089 bash[88398]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:39 smithi089 bash[91918]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:39 smithi089 bash[91918]: audit 2024-09-21T05:39:38.731591+0000 mgr.y (mgr.25142) 765 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:40.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.305 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.305 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.6.service: Deactivated successfully. 2024-09-21T05:39:40.306 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: Stopped Ceph osd.6 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:39:40.306 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.306 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.306 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:40.030892545Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:40.306 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:39:40.696 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:40 smithi110 systemd[1]: Started Ceph osd.6 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:39:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[88398]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:40 smithi089 bash[91918]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.017393+0000 mgr.y (mgr.25142) 766 : cluster [DBG] pgmap v457: 161 pgs: 8 active+undersized, 5 peering, 8 stale+active+clean, 4 active+undersized+degraded, 136 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 14/732 objects degraded (1.913%) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.682875+0000 mon.a (mon.0) 390 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: cluster 2024-09-21T05:39:39.682946+0000 mon.a (mon.0) 391 : cluster [WRN] Health check failed: Degraded data redundancy: 14/732 objects degraded (1.913%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: audit 2024-09-21T05:39:40.377845+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:40 smithi110 bash[70834]: audit 2024-09-21T05:39:40.391460+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:42.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:41 smithi110 bash[83498]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:42.054 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:41 smithi110 bash[83498]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:42 smithi089 bash[88398]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:42 smithi089 bash[88398]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:42 smithi089 bash[91918]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:42 smithi089 bash[91918]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:42 smithi110 bash[70834]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:42 smithi110 bash[70834]: cluster 2024-09-21T05:39:41.018989+0000 mgr.y (mgr.25142) 767 : cluster [DBG] pgmap v458: 161 pgs: 29 active+undersized, 5 peering, 19 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 75/732 objects degraded (10.246%) 2024-09-21T05:39:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:43.048003418Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:43 smithi089 bash[88398]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:44.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:43 smithi089 bash[88398]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:44.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:43 smithi089 bash[91918]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:43 smithi089 bash[91918]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:43 smithi110 bash[70834]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:44.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:43 smithi110 bash[70834]: cluster 2024-09-21T05:39:43.700140+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-21T05:39:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:44 smithi089 bash[88398]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:45.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:44 smithi089 bash[88398]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:45.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:44 smithi089 bash[91918]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:45.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:44 smithi089 bash[91918]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:45.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:44 smithi110 bash[70834]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:44 smithi110 bash[70834]: cluster 2024-09-21T05:39:43.020222+0000 mgr.y (mgr.25142) 768 : cluster [DBG] pgmap v459: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:46.024 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:45 smithi110 bash[83498]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:39:46.024 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:45 smithi110 bash[83498]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:46.024 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:45 smithi110 bash[83498]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:39:46.024 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:45 smithi110 bash[83498]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T05:39:46.024 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:45 smithi110 bash[83498]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-09-21T05:39:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:46.025626062Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:46.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[83498]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-09-21T05:39:46.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[83498]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-09-21T05:39:46.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[83498]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T05:39:46.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[83498]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T05:39:46.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[83498]: --> ceph-volume lvm activate successful for osd ID: 6 2024-09-21T05:39:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:46] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:46 smithi110 bash[70834]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[91918]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: cluster 2024-09-21T05:39:45.021889+0000 mgr.y (mgr.25142) 769 : cluster [DBG] pgmap v460: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: audit 2024-09-21T05:39:46.391920+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:46 smithi089 bash[88398]: audit 2024-09-21T05:39:46.405143+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:47 smithi110 bash[84183]: debug 2024-09-21T05:39:47.979+0000 7f98ed67a640 1 -- 172.21.15.110:0/2204362794 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ed9042960 con 0x563ed9063800 2024-09-21T05:39:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[88398]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:48 smithi089 bash[91918]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: cluster 2024-09-21T05:39:47.023050+0000 mgr.y (mgr.25142) 770 : cluster [DBG] pgmap v461: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: audit 2024-09-21T05:39:47.546469+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:48 smithi110 bash[70834]: audit 2024-09-21T05:39:47.560552+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:49.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:49.023465696Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:49.804 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[84183]: debug 2024-09-21T05:39:49.511+0000 7f98efee1640 -1 Falling back to public interface 2024-09-21T05:39:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[70834]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[70834]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[70834]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:49.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:49 smithi110 bash[70834]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[88398]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:50.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[88398]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[88398]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[88398]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[91918]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[91918]: audit 2024-09-21T05:39:48.742863+0000 mgr.y (mgr.25142) 771 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[91918]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:50.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:49 smithi089 bash[91918]: cluster 2024-09-21T05:39:49.452227+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 88/732 objects degraded (12.022%), 21 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[88398]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:50 smithi089 bash[91918]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: cluster 2024-09-21T05:39:49.024472+0000 mgr.y (mgr.25142) 772 : cluster [DBG] pgmap v462: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 88/732 objects degraded (12.022%) 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: audit 2024-09-21T05:39:50.478728+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:50 smithi110 bash[70834]: audit 2024-09-21T05:39:50.481960+0000 mon.b (mon.1) 256 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:39:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:52.046626139Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:52.986 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:52 smithi110 bash[70834]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:52.987 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:52 smithi110 bash[70834]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:53.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:52 smithi089 bash[88398]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:53.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:52 smithi089 bash[88398]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:53.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:52 smithi089 bash[91918]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:53.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:52 smithi089 bash[91918]: cluster 2024-09-21T05:39:51.026007+0000 mgr.y (mgr.25142) 773 : cluster [DBG] pgmap v463: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:53.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:52 smithi110 bash[84183]: debug 2024-09-21T05:39:52.987+0000 7f98efee1640 -1 osd.6 142 log_to_monitors true 2024-09-21T05:39:53.917 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:53 smithi110 bash[70834]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:53.917 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:53 smithi110 bash[70834]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:53.917 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:53 smithi110 bash[70834]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:53.917 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:53 smithi110 bash[70834]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:53.917 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:39:53 smithi110 bash[84183]: debug 2024-09-21T05:39:53.611+0000 7f98e3c83640 -1 osd.6 142 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:39:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[88398]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[88398]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[88398]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[88398]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[91918]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[91918]: audit 2024-09-21T05:39:52.991917+0000 mon.a (mon.0) 401 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[91918]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:54.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:53 smithi089 bash[91918]: audit 2024-09-21T05:39:52.991931+0000 mon.b (mon.1) 257 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.022 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:54 smithi110 bash[70834]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[88398]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: cluster 2024-09-21T05:39:53.027097+0000 mgr.y (mgr.25142) 774 : cluster [DBG] pgmap v464: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.568988+0000 mon.a (mon.0) 402 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: cluster 2024-09-21T05:39:53.577862+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e145: 8 total, 7 up, 8 in 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.581944+0000 mon.a (mon.0) 404 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:54 smithi089 bash[91918]: audit 2024-09-21T05:39:53.581978+0000 mon.b (mon.1) 258 : audit [INF] from='osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:39:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:55.022844263Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:55.912 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:55 smithi110 bash[70834]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:56.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[88398]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:56.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.569906+0000 mon.a (mon.0) 405 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: audit 2024-09-21T05:39:54.582241+0000 mon.b (mon.1) 259 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.588324+0000 mon.a (mon.0) 406 : cluster [INF] osd.6 [v2:172.21.15.110:6816/4044689068,v1:172.21.15.110:6817/4044689068] boot 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:54.588431+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:56.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:55 smithi089 bash[91918]: cluster 2024-09-21T05:39:55.585085+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-09-21T05:39:56.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:39:56] "GET /metrics HTTP/1.1" 200 38337 "" "Prometheus/2.51.0" 2024-09-21T05:39:57.004 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:56 smithi110 bash[70834]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.004 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:56 smithi110 bash[70834]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:56 smithi089 bash[88398]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:56 smithi089 bash[88398]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:56 smithi089 bash[91918]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:56 smithi089 bash[91918]: cluster 2024-09-21T05:39:55.028189+0000 mgr.y (mgr.25142) 775 : cluster [DBG] pgmap v467: 161 pgs: 32 active+undersized, 21 active+undersized+degraded, 108 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 88/732 objects degraded (12.022%) 2024-09-21T05:39:57.573 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:39:57.943 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:57 smithi089 bash[91918]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:57.943 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:57 smithi089 bash[91918]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:57.943 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:57 smithi089 bash[88398]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:57.943 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:57 smithi089 bash[88398]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:58.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:57 smithi110 bash[70834]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:58.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:57 smithi110 bash[70834]: cluster 2024-09-21T05:39:57.622425+0000 mon.a (mon.0) 409 : cluster [WRN] Health check update: Degraded data redundancy: 71/732 objects degraded (9.699%), 17 pgs degraded (PG_DEGRADED) 2024-09-21T05:39:58.217 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:39:58.217 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (12m) 2m ago 39m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:39:58.217 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (11m) 11s ago 39m 70.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:39:58.217 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (14m) 2m ago 36m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:39:58.217 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (13m) 11s ago 47m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (24m) 2m ago 50m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (8m) 2m ago 50m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (10m) 11s ago 48m 47.0M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (8m) 2m ago 48m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (13m) 2m ago 39m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (13m) 11s ago 39m 8536k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 2m ago 47m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 2m ago 46m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 2m ago 45m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 2m ago 44m - 3036M 2024-09-21T05:39:58.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (100s) 11s ago 43m 51.3M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (56s) 11s ago 42m 53.2M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running 11s ago 41m - 3292M 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (40m) 11s ago 40m 73.4M 3292M 19.1.1-373-g4e45e6b4 164465d2334a 601ecd42af37 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (12m) 11s ago 39m 54.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (37m) 2m ago 37m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:39:58.219 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (37m) 11s ago 37m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:39:58.296 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:39:57 smithi089 bash[68019]: debug 2024-09-21T05:39:57.941+0000 7f1a88244640 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:39:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:39:58.048733428Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:39:58.592 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:39:58.592 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:39:58.592 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:39:58.592 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 7 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 12 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:39:58.593 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:39:58.911 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:39:58.911 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "5/8 daemons upgraded", 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:39:58.912 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[88398]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:58 smithi089 bash[91918]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: cluster 2024-09-21T05:39:57.029405+0000 mgr.y (mgr.25142) 776 : cluster [DBG] pgmap v469: 161 pgs: 27 active+undersized, 17 active+undersized+degraded, 117 active+clean; 585 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 71/732 objects degraded (9.699%) 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.560795+0000 mgr.y (mgr.25142) 777 : audit [DBG] from='client.54536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.775879+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.789963+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.794247+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.796286+0000 mon.b (mon.1) 261 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.808449+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.934006+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.937225+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.939594+0000 mon.b (mon.1) 264 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.941652+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:57.944087+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:39:59.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:58 smithi110 bash[70834]: audit 2024-09-21T05:39:58.592984+0000 mon.a (mon.0) 413 : audit [DBG] from='client.? 172.21.15.89:0/2859624420' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:00.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[88398]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:00.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:39:59 smithi089 bash[91918]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:57.887796+0000 mgr.y (mgr.25142) 778 : audit [DBG] from='client.44568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:57.943670+0000 mgr.y (mgr.25142) 779 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: cephadm 2024-09-21T05:39:57.945116+0000 mgr.y (mgr.25142) 780 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:58.199808+0000 mgr.y (mgr.25142) 781 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:00.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:00.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:39:59 smithi110 bash[70834]: audit 2024-09-21T05:39:58.750023+0000 mgr.y (mgr.25142) 782 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:01.024111402Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: audit 2024-09-21T05:39:58.911652+0000 mgr.y (mgr.25142) 783 : audit [DBG] from='client.44586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:39:59.030863+0000 mgr.y (mgr.25142) 784 : cluster [DBG] pgmap v470: 161 pgs: 11 active+undersized, 8 active+undersized+degraded, 142 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 32/732 objects degraded (4.372%) 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000182+0000 mon.a (mon.0) 414 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000216+0000 mon.a (mon.0) 415 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000234+0000 mon.a (mon.0) 416 : cluster [WRN] pg 2.19 is active+undersized+degraded, acting [3,0] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000249+0000 mon.a (mon.0) 417 : cluster [WRN] pg 3.2 is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000268+0000 mon.a (mon.0) 418 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,0] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000284+0000 mon.a (mon.0) 419 : cluster [WRN] pg 3.14 is active+undersized+degraded, acting [4,7] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000320+0000 mon.a (mon.0) 420 : cluster [WRN] pg 3.1e is active+undersized+degraded, acting [3,2] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000339+0000 mon.a (mon.0) 421 : cluster [WRN] pg 4.e is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000365+0000 mon.a (mon.0) 422 : cluster [WRN] pg 5.18 is active+undersized+degraded, acting [4,1] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:01.056 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:00.000394+0000 mon.a (mon.0) 423 : cluster [WRN] pg 6.c is active+undersized+degraded, acting [3,5] 2024-09-21T05:40:02.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[88398]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:02.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:01 smithi089 bash[91918]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.032163+0000 mgr.y (mgr.25142) 785 : cluster [DBG] pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.778018+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/732 objects degraded (4.372%), 8 pgs degraded) 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:02.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:01 smithi110 bash[70834]: cluster 2024-09-21T05:40:01.778067+0000 mon.a (mon.0) 425 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:04.045337851Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:04 smithi110 bash[70834]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:04 smithi110 bash[70834]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:04.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:04 smithi089 bash[88398]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:04.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:04 smithi089 bash[88398]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:04.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:04 smithi089 bash[91918]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:04.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:04 smithi089 bash[91918]: cluster 2024-09-21T05:40:03.033119+0000 mgr.y (mgr.25142) 786 : cluster [DBG] pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 484 B/s rd, 0 op/s 2024-09-21T05:40:06.474 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:06] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[88398]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:06.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:06 smithi089 bash[91918]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: cluster 2024-09-21T05:40:05.034505+0000 mgr.y (mgr.25142) 787 : cluster [DBG] pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: audit 2024-09-21T05:40:05.476933+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:06.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:06 smithi110 bash[70834]: audit 2024-09-21T05:40:05.480197+0000 mon.b (mon.1) 267 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:07.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:07.058225469Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:08.759 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:08 smithi089 bash[88398]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:08.759 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:08 smithi089 bash[88398]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:08.759 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:08 smithi089 bash[91918]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:08.759 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:08 smithi089 bash[91918]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:08 smithi110 bash[70834]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:08.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:08 smithi110 bash[70834]: cluster 2024-09-21T05:40:07.035523+0000 mgr.y (mgr.25142) 788 : cluster [DBG] pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 804 B/s rd, 0 op/s 2024-09-21T05:40:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:09 smithi089 bash[88398]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:09.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:09 smithi089 bash[88398]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:09 smithi089 bash[91918]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:09.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:09 smithi089 bash[91918]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:09 smithi110 bash[70834]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:09.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:09 smithi110 bash[70834]: audit 2024-09-21T05:40:08.758941+0000 mgr.y (mgr.25142) 789 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:10.0490673Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:10.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:10 smithi089 bash[88398]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:10.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:10 smithi089 bash[88398]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:10 smithi089 bash[91918]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:10.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:10 smithi089 bash[91918]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:10 smithi110 bash[70834]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:10.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:10 smithi110 bash[70834]: cluster 2024-09-21T05:40:09.036811+0000 mgr.y (mgr.25142) 790 : cluster [DBG] pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-21T05:40:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[88398]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[88398]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[88398]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:12.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[88398]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[91918]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[91918]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[91918]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:12.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:11 smithi089 bash[91918]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:11 smithi110 bash[70834]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:11 smithi110 bash[70834]: audit 2024-09-21T05:40:10.807558+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:11 smithi110 bash[70834]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:12.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:11 smithi110 bash[70834]: cluster 2024-09-21T05:40:11.038125+0000 mgr.y (mgr.25142) 791 : cluster [DBG] pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:13 smithi089 bash[88398]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:13 smithi089 bash[88398]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:13 smithi089 bash[91918]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:13 smithi089 bash[91918]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.303 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:13 smithi110 bash[70834]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:13 smithi110 bash[70834]: audit 2024-09-21T05:40:12.954196+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16} : dispatch 2024-09-21T05:40:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:13.03914409Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:14.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.296 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[91918]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:14.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:14 smithi089 bash[88398]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: audit 2024-09-21T05:40:12.954032+0000 mgr.y (mgr.25142) 792 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: cephadm 2024-09-21T05:40:12.957016+0000 mgr.y (mgr.25142) 793 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:14.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:14 smithi110 bash[70834]: cluster 2024-09-21T05:40:13.038969+0000 mgr.y (mgr.25142) 794 : cluster [DBG] pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:16.047098589Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:16] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:40:17.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[88398]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:17.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:16 smithi089 bash[91918]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cluster 2024-09-21T05:40:15.040355+0000 mgr.y (mgr.25142) 795 : cluster [DBG] pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cephadm 2024-09-21T05:40:15.591090+0000 mgr.y (mgr.25142) 796 : cephadm [INF] Upgrade: Updating osd.7 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.599507+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.605935+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: audit 2024-09-21T05:40:15.607975+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:16 smithi110 bash[70834]: cephadm 2024-09-21T05:40:15.613025+0000 mgr.y (mgr.25142) 797 : cephadm [INF] Deploying daemon osd.7 on smithi110 2024-09-21T05:40:19.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:18 smithi110 bash[70834]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:18 smithi110 bash[70834]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:18 smithi089 bash[88398]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:18 smithi089 bash[88398]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:18 smithi089 bash[91918]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:18 smithi089 bash[91918]: cluster 2024-09-21T05:40:17.041333+0000 mgr.y (mgr.25142) 798 : cluster [DBG] pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:19.044798406Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:19 smithi089 bash[88398]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:19 smithi089 bash[88398]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:19 smithi089 bash[91918]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:19 smithi089 bash[91918]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:19 smithi110 bash[70834]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:19 smithi110 bash[70834]: audit 2024-09-21T05:40:18.770225+0000 mgr.y (mgr.25142) 799 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:20.747 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.748 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.748 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.748 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.749 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.749 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.749 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: Stopping Ceph osd.7 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:40:20.749 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.749 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[70834]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:20.749 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[70834]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:20.749 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[70834]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:20.749 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[70834]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:20.750 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:20.750 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:40:20 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[88398]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[88398]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[88398]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[88398]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[91918]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[91918]: cluster 2024-09-21T05:40:19.042629+0000 mgr.y (mgr.25142) 800 : cluster [DBG] pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[91918]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:20 smithi089 bash[91918]: audit 2024-09-21T05:40:20.471140+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[42001]: debug 2024-09-21T05:40:20.746+0000 7ff858101640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:40:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[42001]: debug 2024-09-21T05:40:20.746+0000 7ff858101640 -1 osd.7 147 *** Got signal Terminated *** 2024-09-21T05:40:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:20 smithi110 bash[42001]: debug 2024-09-21T05:40:20.746+0000 7ff858101640 -1 osd.7 147 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:40:22.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:21 smithi110 bash[70834]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.038 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:21 smithi110 bash[70834]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:21 smithi089 bash[88398]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:21 smithi089 bash[88398]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:21 smithi089 bash[91918]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:21 smithi089 bash[91918]: cluster 2024-09-21T05:40:20.749076+0000 mon.a (mon.0) 429 : cluster [INF] osd.7 marked itself down and dead 2024-09-21T05:40:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:22.043162457Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:22.875 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[87767]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-7 2024-09-21T05:40:22.875 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:22.876 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:22.876 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:22.876 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:22.876 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:22.876 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[70834]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[88398]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.043986+0000 mgr.y (mgr.25142) 801 : cluster [DBG] pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.613209+0000 mon.a (mon.0) 430 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:22 smithi089 bash[91918]: cluster 2024-09-21T05:40:21.629764+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e148: 8 total, 7 up, 8 in 2024-09-21T05:40:23.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:22 smithi110 bash[87830]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-7 2024-09-21T05:40:24.031 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:23 smithi110 bash[70834]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.031 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:23 smithi110 bash[70834]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:23 smithi089 bash[88398]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:23 smithi089 bash[88398]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:23 smithi089 bash[91918]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:23 smithi089 bash[91918]: cluster 2024-09-21T05:40:22.633883+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e149: 8 total, 7 up, 8 in 2024-09-21T05:40:24.900 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:24 smithi110 bash[70834]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:24.901 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:24 smithi110 bash[70834]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:24.901 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:24 smithi110 bash[70834]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:24.901 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:24 smithi110 bash[70834]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:25.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[91918]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:25.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[91918]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:25.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[91918]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[91918]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[88398]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[88398]: cluster 2024-09-21T05:40:23.044804+0000 mgr.y (mgr.25142) 802 : cluster [DBG] pgmap v484: 161 pgs: 5 peering, 22 stale+active+clean, 134 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-09-21T05:40:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[88398]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:24 smithi089 bash[88398]: cluster 2024-09-21T05:40:23.625176+0000 mon.a (mon.0) 433 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.158 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.158 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.158 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:25.023698076Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:25.158 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.159 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.159 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.159 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.160 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:24 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.7.service: Deactivated successfully. 2024-09-21T05:40:25.160 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:24 smithi110 systemd[1]: Stopped Ceph osd.7 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:40:25.160 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:25.160 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: Started Ceph osd.7 for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:40:25.160 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:40:25 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:40:26.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.496 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.497 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.497 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.497 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[70834]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:26] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[88398]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: cluster 2024-09-21T05:40:25.046660+0000 mgr.y (mgr.25142) 803 : cluster [DBG] pgmap v485: 161 pgs: 34 active+undersized, 5 peering, 3 stale+active+clean, 24 active+undersized+degraded, 95 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: audit 2024-09-21T05:40:25.212683+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: audit 2024-09-21T05:40:25.226674+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.548 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:26 smithi089 bash[91918]: cluster 2024-09-21T05:40:25.635772+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Degraded data redundancy: 93/732 objects degraded (12.705%), 24 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:26.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[87976]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:40:26.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:26 smithi110 bash[87976]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:40:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:28.04026397Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:28 smithi110 bash[70834]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:28.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:28 smithi110 bash[70834]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:28.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:28 smithi089 bash[88398]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:28.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:28 smithi089 bash[88398]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:28.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:28 smithi089 bash[91918]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:28.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:28 smithi089 bash[91918]: cluster 2024-09-21T05:40:27.047828+0000 mgr.y (mgr.25142) 804 : cluster [DBG] pgmap v486: 161 pgs: 40 active+undersized, 5 peering, 24 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 93/732 objects degraded (12.705%) 2024-09-21T05:40:29.257 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:40:29.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:29 smithi089 bash[88398]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:29 smithi089 bash[88398]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:29 smithi089 bash[91918]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:29 smithi089 bash[91918]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:29 smithi110 bash[70834]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:29 smithi110 bash[70834]: audit 2024-09-21T05:40:28.778248+0000 mgr.y (mgr.25142) 805 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:29.909 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:40:29.909 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (13m) 2m ago 39m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:40:29.909 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (12m) 43s ago 39m 70.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:40:29.909 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (14m) 2m ago 37m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:40:29.909 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (14m) 43s ago 48m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (25m) 2m ago 50m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (9m) 2m ago 50m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (10m) 43s ago 48m 47.0M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (8m) 2m ago 48m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (14m) 2m ago 40m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (14m) 43s ago 40m 8536k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 2m ago 47m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 2m ago 46m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 2m ago 45m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 2m ago 44m - 3036M 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (2m) 43s ago 44m 51.3M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (87s) 43s ago 43m 53.2M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:40:29.910 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running 43s ago 42m - 3292M 2024-09-21T05:40:29.911 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 starting - - - 3292M 2024-09-21T05:40:29.911 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (13m) 43s ago 40m 54.4M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:40:29.911 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (37m) 2m ago 37m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:40:29.911 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (37m) 43s ago 37m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:40:30.288 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 7 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:40:30.289 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:40:30.290 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:40:30.290 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 12 2024-09-21T05:40:30.290 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:40:30.290 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:40:30.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[91918]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.548 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:30 smithi089 bash[88398]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.553 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: cluster 2024-09-21T05:40:29.048859+0000 mgr.y (mgr.25142) 806 : cluster [DBG] pgmap v487: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: cluster 2024-09-21T05:40:29.214567+0000 mon.a (mon.0) 437 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: audit 2024-09-21T05:40:29.245095+0000 mgr.y (mgr.25142) 807 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[70834]: audit 2024-09-21T05:40:29.569451+0000 mgr.y (mgr.25142) 808 : audit [DBG] from='client.54572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:30.554 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T05:40:30.554 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:40:30.555 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T05:40:30.555 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T05:40:30.555 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "5/8 daemons upgraded", 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T05:40:30.609 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:40:30.610 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:40:31.026 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-09-21T05:40:31.026 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-09-21T05:40:31.026 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-09-21T05:40:31.026 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T05:40:31.026 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:30 smithi110 bash[87976]: --> ceph-volume lvm activate successful for osd ID: 7 2024-09-21T05:40:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:31.02714223Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:31 smithi110 bash[70834]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[88398]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:29.873158+0000 mgr.y (mgr.25142) 809 : audit [DBG] from='client.54578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:30.289208+0000 mon.a (mon.0) 438 : audit [DBG] from='client.? 172.21.15.89:0/2768995071' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:31.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:31 smithi089 bash[91918]: audit 2024-09-21T05:40:30.609277+0000 mgr.y (mgr.25142) 810 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:40:32.511 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.511 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.512 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.512 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.512 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.512 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[70834]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[88398]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: cluster 2024-09-21T05:40:31.050473+0000 mgr.y (mgr.25142) 811 : cluster [DBG] pgmap v488: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: audit 2024-09-21T05:40:31.248455+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:32 smithi089 bash[91918]: audit 2024-09-21T05:40:31.260291+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:32.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:32 smithi110 bash[88678]: debug 2024-09-21T05:40:32.594+0000 7f39a982f640 1 -- 172.21.15.110:0/2143214935 <== mon.1 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d568918960 con 0x55d569706000 2024-09-21T05:40:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[88398]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[88398]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[88398]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[88398]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[91918]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[91918]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[91918]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:33 smithi089 bash[91918]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:33 smithi110 bash[70834]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:33 smithi110 bash[70834]: audit 2024-09-21T05:40:32.392927+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:33 smithi110 bash[70834]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:33.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:33 smithi110 bash[70834]: audit 2024-09-21T05:40:32.405247+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:34.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:34 smithi110 bash[88678]: debug 2024-09-21T05:40:34.130+0000 7f39ac096640 -1 Falling back to public interface 2024-09-21T05:40:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:34.045499407Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:34 smithi089 bash[88398]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:34 smithi089 bash[88398]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:34 smithi089 bash[91918]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:34 smithi089 bash[91918]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:34 smithi110 bash[70834]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:34 smithi110 bash[70834]: cluster 2024-09-21T05:40:33.051655+0000 mgr.y (mgr.25142) 812 : cluster [DBG] pgmap v489: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:35.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:35 smithi089 bash[88398]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:35.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:35 smithi089 bash[88398]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:35.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:35 smithi089 bash[91918]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:35.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:35 smithi089 bash[91918]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:35 smithi110 bash[70834]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:35 smithi110 bash[70834]: cluster 2024-09-21T05:40:34.462198+0000 mon.a (mon.0) 443 : cluster [WRN] Health check update: Degraded data redundancy: 96/732 objects degraded (13.115%), 27 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:36.476 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:36] "GET /metrics HTTP/1.1" 200 38336 "" "Prometheus/2.51.0" 2024-09-21T05:40:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[88398]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:36.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:36 smithi089 bash[91918]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: cluster 2024-09-21T05:40:35.053458+0000 mgr.y (mgr.25142) 813 : cluster [DBG] pgmap v490: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 96/732 objects degraded (13.115%) 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: audit 2024-09-21T05:40:35.479466+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:36 smithi110 bash[70834]: audit 2024-09-21T05:40:35.482506+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:37.030803965Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:37.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:37 smithi110 bash[88678]: debug 2024-09-21T05:40:37.550+0000 7f39ac096640 -1 osd.7 147 log_to_monitors true 2024-09-21T05:40:38.743 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[88678]: debug 2024-09-21T05:40:38.530+0000 7f399fe38640 -1 osd.7 147 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.743 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:38 smithi110 bash[70834]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[88398]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: cluster 2024-09-21T05:40:37.054587+0000 mgr.y (mgr.25142) 814 : cluster [DBG] pgmap v491: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 254 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: audit 2024-09-21T05:40:37.556096+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:38.788 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:38 smithi089 bash[91918]: audit 2024-09-21T05:40:37.556246+0000 mon.b (mon.1) 273 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:39.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[88398]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:39.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:39 smithi089 bash[91918]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.489285+0000 mon.a (mon.0) 446 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: cluster 2024-09-21T05:40:38.496952+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e150: 8 total, 7 up, 8 in 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.498204+0000 mon.b (mon.1) 274 : audit [INF] from='osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.499656+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi110", "root=default"]} : dispatch 2024-09-21T05:40:39.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:39.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:39 smithi110 bash[70834]: audit 2024-09-21T05:40:38.787409+0000 mgr.y (mgr.25142) 815 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:40.529 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:40.059823349Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:40.787 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.787 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.787 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:40.788 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:40 smithi110 bash[70834]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:40.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[88398]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.056062+0000 mgr.y (mgr.25142) 816 : cluster [DBG] pgmap v493: 161 pgs: 42 active+undersized, 27 active+undersized+degraded, 92 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 96/732 objects degraded (13.115%) 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.491116+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.509620+0000 mon.a (mon.0) 450 : cluster [INF] osd.7 [v2:172.21.15.110:6824/1965823036,v1:172.21.15.110:6825/1965823036] boot 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: cluster 2024-09-21T05:40:39.510090+0000 mon.a (mon.0) 451 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:40.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:40 smithi089 bash[91918]: audit 2024-09-21T05:40:39.520626+0000 mon.b (mon.1) 275 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T05:40:41.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:41 smithi089 bash[91918]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:41.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:41 smithi089 bash[91918]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:41 smithi089 bash[88398]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:41.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:41 smithi089 bash[88398]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:41.803 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:41 smithi110 bash[70834]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:41.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:41 smithi110 bash[70834]: cluster 2024-09-21T05:40:40.509856+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-09-21T05:40:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[88398]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[88398]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[88398]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[88398]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[91918]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[91918]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[91918]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:42.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:42 smithi089 bash[91918]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:42 smithi110 bash[70834]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:42 smithi110 bash[70834]: cluster 2024-09-21T05:40:41.057219+0000 mgr.y (mgr.25142) 817 : cluster [DBG] pgmap v496: 161 pgs: 16 peering, 30 active+undersized, 20 active+undersized+degraded, 95 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 64/732 objects degraded (8.743%) 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:42 smithi110 bash[70834]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:42.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:42 smithi110 bash[70834]: cluster 2024-09-21T05:40:41.525752+0000 mon.a (mon.0) 453 : cluster [WRN] Health check update: Degraded data redundancy: 64/732 objects degraded (8.743%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T05:40:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:43.044151766Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.050 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.051 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.052 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.053 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.054 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.055 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.056 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.057 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.057 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.058 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.059 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.060 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.061 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.062 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.063 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.064 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.065 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.066 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.067 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.069 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.070 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.071 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.072 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.073 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.074 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.075 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.076 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.077 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.078 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.079 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.079 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.079 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[91918]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.080 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.081 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.082 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.083 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:43 smithi089 bash[88398]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.084 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.637021+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.652605+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.656821+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.658986+0000 mon.b (mon.1) 277 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.671678+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.803022+0000 mon.b (mon.1) 278 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.806686+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.085 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.809330+0000 mon.b (mon.1) 280 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.811557+0000 mon.b (mon.1) 281 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.815123+0000 mon.b (mon.1) 282 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.823902+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.831568+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.831591+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.839994+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T05:40:44.086 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.845359+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.845393+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.853362+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.858872+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.858973+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.864899+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.870246+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.087 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.870249+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.876045+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.881371+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.881429+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.887504+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.892879+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.893022+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.088 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.898749+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.904137+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.904149+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.6"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.909807+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.914995+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.915379+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.7"} : dispatch 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.921067+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-09-21T05:40:44.089 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.931166+0000 mon.b (mon.1) 291 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.940184+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.947999+0000 mon.b (mon.1) 292 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.956165+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.964790+0000 mon.b (mon.1) 293 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.968129+0000 mon.b (mon.1) 294 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.975887+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.090 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.983692+0000 mon.b (mon.1) 295 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:42.992028+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.000958+0000 mon.b (mon.1) 296 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.009576+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.017042+0000 mon.b (mon.1) 297 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.020820+0000 mon.b (mon.1) 298 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.091 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.024587+0000 mon.b (mon.1) 299 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.028503+0000 mon.b (mon.1) 300 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.032003+0000 mon.b (mon.1) 301 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.035621+0000 mon.b (mon.1) 302 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.041152+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.041180+0000 mon.b (mon.1) 303 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.047321+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.053802+0000 mon.b (mon.1) 304 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.092 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.053900+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.059808+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.065199+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.065324+0000 mon.b (mon.1) 305 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.071096+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.076247+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.093 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.076278+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.082183+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.087331+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.087352+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.093142+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.099006+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.099029+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.094 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.101721+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.101766+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.107544+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.113334+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.113355+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.116050+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.116086+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.095 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.122316+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.127641+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.127775+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.130574+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.130622+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.136728+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.141811+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.096 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.141883+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.146810+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.153064+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.153138+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.156249+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.156336+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.159050+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.159065+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.097 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.161768+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.161785+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.166510+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.166664+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.169151+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.169223+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.098 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.172277+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.172313+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.177971+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.181638+0000 mon.b (mon.1) 322 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.183402+0000 mon.b (mon.1) 323 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.193996+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.319670+0000 mon.b (mon.1) 324 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.321694+0000 mon.b (mon.1) 325 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:40:44.099 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:44.100 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:43 smithi110 bash[70834]: audit 2024-09-21T05:40:43.329632+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[88398]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:45.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:44 smithi089 bash[91918]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.815893+0000 mgr.y (mgr.25142) 818 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:40:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.932414+0000 mgr.y (mgr.25142) 819 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.949213+0000 mgr.y (mgr.25142) 820 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.969173+0000 mgr.y (mgr.25142) 821 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:42.984756+0000 mgr.y (mgr.25142) 822 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.002071+0000 mgr.y (mgr.25142) 823 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.036813+0000 mgr.y (mgr.25142) 824 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cluster 2024-09-21T05:40:43.058385+0000 mgr.y (mgr.25142) 825 : cluster [DBG] pgmap v497: 161 pgs: 16 peering, 28 active+undersized, 18 active+undersized+degraded, 99 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 62/732 objects degraded (8.470%) 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:45.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:44 smithi110 bash[70834]: cephadm 2024-09-21T05:40:43.170640+0000 mgr.y (mgr.25142) 826 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:40:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:45 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:45 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:45 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.639448+0000 mon.a (mon.0) 510 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 62/732 objects degraded (8.470%), 18 pgs degraded) 2024-09-21T05:40:46.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:45 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.052 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:45 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.639495+0000 mon.a (mon.0) 511 : cluster [INF] Cluster is now healthy 2024-09-21T05:40:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:46.05369483Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:46] "GET /metrics HTTP/1.1" 200 38336 "" "Prometheus/2.51.0" 2024-09-21T05:40:47.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[91918]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[91918]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[91918]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[88398]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[88398]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:47.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:46 smithi089 bash[88398]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:46 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:46 smithi110 bash[70834]: cluster 2024-09-21T05:40:45.059924+0000 mgr.y (mgr.25142) 827 : cluster [DBG] pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-21T05:40:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:46 smithi110 bash[70834]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:46 smithi110 bash[70834]: audit 2024-09-21T05:40:45.831738+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:48 smithi089 bash[88398]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:48 smithi089 bash[88398]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:48 smithi089 bash[91918]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:48 smithi089 bash[91918]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:48 smithi110 bash[70834]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:48 smithi110 bash[70834]: cluster 2024-09-21T05:40:47.060731+0000 mgr.y (mgr.25142) 828 : cluster [DBG] pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:49.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:49.069412455Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:51.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[88398]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:51.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:50 smithi089 bash[91918]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:48.798180+0000 mgr.y (mgr.25142) 829 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: cluster 2024-09-21T05:40:49.062087+0000 mgr.y (mgr.25142) 830 : cluster [DBG] pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:50.479447+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:51.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:51.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:50 smithi110 bash[70834]: audit 2024-09-21T05:40:50.482728+0000 mon.b (mon.1) 326 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:40:52.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[88398]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[88398]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[88398]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[88398]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[91918]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[91918]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[91918]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:52.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:51 smithi089 bash[91918]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:52.062459593Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:51 smithi110 bash[70834]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:51 smithi110 bash[70834]: audit 2024-09-21T05:40:50.846807+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:40:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:51 smithi110 bash[70834]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:52.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:51 smithi110 bash[70834]: cluster 2024-09-21T05:40:51.063254+0000 mgr.y (mgr.25142) 831 : cluster [DBG] pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 969 B/s rd, 0 op/s 2024-09-21T05:40:54.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:54 smithi089 bash[88398]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:54.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:54 smithi089 bash[88398]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:54.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:54 smithi089 bash[91918]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:54.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:54 smithi089 bash[91918]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:54.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:54 smithi110 bash[70834]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:54.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:54 smithi110 bash[70834]: cluster 2024-09-21T05:40:53.064253+0000 mgr.y (mgr.25142) 832 : cluster [DBG] pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:55.029286761Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:56.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:56 smithi089 bash[88398]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:56.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:56 smithi089 bash[88398]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:56.547 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:40:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:40:56] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:40:56.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:56 smithi089 bash[91918]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:56.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:56 smithi089 bash[91918]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:56.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:56 smithi110 bash[70834]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:56.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:56 smithi110 bash[70834]: cluster 2024-09-21T05:40:55.065865+0000 mgr.y (mgr.25142) 833 : cluster [DBG] pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:40:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:40:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:40:58.046555685Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:40:58.328 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:58 smithi110 bash[70834]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:58.328 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:40:58 smithi110 bash[70834]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:58.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:58 smithi089 bash[88398]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:58.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:40:58 smithi089 bash[88398]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:58.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:58 smithi089 bash[91918]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:40:58.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:40:58 smithi089 bash[91918]: cluster 2024-09-21T05:40:57.066670+0000 mgr.y (mgr.25142) 834 : cluster [DBG] pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[91918]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[91918]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[91918]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[88398]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[88398]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:00 smithi089 bash[88398]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:00 smithi110 bash[70834]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:00 smithi110 bash[70834]: audit 2024-09-21T05:40:58.806249+0000 mgr.y (mgr.25142) 835 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:00.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:00 smithi110 bash[70834]: cluster 2024-09-21T05:40:59.068018+0000 mgr.y (mgr.25142) 836 : cluster [DBG] pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:01.033920782Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:02.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:41:02.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[88398]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[88398]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[88398]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[88398]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[91918]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[91918]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[91918]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:02.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:02 smithi089 bash[91918]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:02 smithi110 bash[70834]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:02 smithi110 bash[70834]: audit 2024-09-21T05:41:00.945566+0000 mgr.y (mgr.25142) 837 : audit [DBG] from='client.54599 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:02 smithi110 bash[70834]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:02.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:02 smithi110 bash[70834]: cluster 2024-09-21T05:41:01.068781+0000 mgr.y (mgr.25142) 838 : cluster [DBG] pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:04.022139537Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:04 smithi110 bash[70834]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:04.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:04 smithi110 bash[70834]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:04.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:04 smithi089 bash[88398]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:04.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:04 smithi089 bash[88398]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:04.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:04 smithi089 bash[91918]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:04.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:04 smithi089 bash[91918]: cluster 2024-09-21T05:41:03.069637+0000 mgr.y (mgr.25142) 839 : cluster [DBG] pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:06] "GET /metrics HTTP/1.1" 200 38329 "" "Prometheus/2.51.0" 2024-09-21T05:41:06.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[88398]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[88398]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[88398]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[88398]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[91918]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[91918]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[91918]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:06 smithi089 bash[91918]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:06 smithi110 bash[70834]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:06 smithi110 bash[70834]: cluster 2024-09-21T05:41:05.071113+0000 mgr.y (mgr.25142) 840 : cluster [DBG] pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:06.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:06 smithi110 bash[70834]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:06 smithi110 bash[70834]: audit 2024-09-21T05:41:05.472337+0000 mon.b (mon.1) 327 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:06.875 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:07.048573899Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (13m) 3m ago 40m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (12m) 37s ago 40m 70.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (15m) 3m ago 38m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (15m) 37s ago 48m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (25m) 3m ago 51m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (9m) 3m ago 51m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (11m) 37s ago 49m 48.4M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (9m) 3m ago 49m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:41:08.528 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (14m) 3m ago 40m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (14m) 37s ago 40m 8544k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (7m) 3m ago 48m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 3m ago 47m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 3m ago 46m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 3m ago 45m - 3036M 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (2m) 37s ago 44m 52.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (2m) 37s ago 43m 53.9M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (81s) 37s ago 42m 48.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 9503bc5aac84 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running 37s ago 41m - 3292M 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (14m) 37s ago 41m 54.5M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (38m) 3m ago 38m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:41:08.529 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (38m) 37s ago 38m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:41:08.540 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:08 smithi089 bash[88398]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:08.540 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:08 smithi089 bash[88398]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:08.540 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:08 smithi089 bash[91918]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:08.541 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:08 smithi089 bash[91918]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:08.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:08 smithi110 bash[70834]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:08.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:08 smithi110 bash[70834]: cluster 2024-09-21T05:41:07.071965+0000 mgr.y (mgr.25142) 841 : cluster [DBG] pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:09.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 1'"'"'' 2024-09-21T05:41:09.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:09 smithi089 bash[88398]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:09.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:09 smithi089 bash[88398]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:09.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:09 smithi089 bash[91918]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:09.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:09 smithi089 bash[91918]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:09.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:09 smithi110 bash[70834]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:09.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:09 smithi110 bash[70834]: audit 2024-09-21T05:41:08.491836+0000 mgr.y (mgr.25142) 842 : audit [DBG] from='client.54605 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:10.039424173Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:10 smithi110 bash[70834]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:10 smithi110 bash[70834]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:10 smithi110 bash[70834]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:10.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:10 smithi110 bash[70834]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:10.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[88398]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[88398]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[88398]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[88398]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[91918]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[91918]: audit 2024-09-21T05:41:08.814122+0000 mgr.y (mgr.25142) 843 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[91918]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:10.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:10 smithi089 bash[91918]: cluster 2024-09-21T05:41:09.072848+0000 mgr.y (mgr.25142) 844 : cluster [DBG] pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:12 smithi089 bash[88398]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:12.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:12 smithi089 bash[88398]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:12 smithi089 bash[91918]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:12.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:12 smithi089 bash[91918]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:12.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:12 smithi110 bash[70834]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:12.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:12 smithi110 bash[70834]: cluster 2024-09-21T05:41:11.073973+0000 mgr.y (mgr.25142) 845 : cluster [DBG] pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:13.026399297Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:14.114 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:14.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:14 smithi089 bash[91918]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:14.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:14 smithi089 bash[91918]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:14 smithi089 bash[88398]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:14.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:14 smithi089 bash[88398]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:14 smithi110 bash[70834]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:14.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:14 smithi110 bash[70834]: cluster 2024-09-21T05:41:13.074835+0000 mgr.y (mgr.25142) 846 : cluster [DBG] pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:15.783 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:41:16.481 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:16] "GET /metrics HTTP/1.1" 200 38329 "" "Prometheus/2.51.0" 2024-09-21T05:41:16.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.osd | keys'"'"' | grep $sha1' 2024-09-21T05:41:16.483 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:16.059363772Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[88398]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[88398]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[88398]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[88398]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[91918]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[91918]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[91918]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:16.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:16 smithi089 bash[91918]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:16 smithi110 bash[70834]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:16 smithi110 bash[70834]: cluster 2024-09-21T05:41:15.075985+0000 mgr.y (mgr.25142) 847 : cluster [DBG] pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:16 smithi110 bash[70834]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:16.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:16 smithi110 bash[70834]: audit 2024-09-21T05:41:15.771582+0000 mon.a (mon.0) 515 : audit [DBG] from='client.? 172.21.15.89:0/2048042167' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:18.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:18 smithi089 bash[88398]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:18.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:18 smithi089 bash[88398]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:18 smithi089 bash[91918]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:18.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:18 smithi089 bash[91918]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:18 smithi110 bash[70834]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:18.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:18 smithi110 bash[70834]: cluster 2024-09-21T05:41:17.076770+0000 mgr.y (mgr.25142) 848 : cluster [DBG] pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:19.033414365Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[88398]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:20.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:20 smithi089 bash[91918]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: audit 2024-09-21T05:41:18.824543+0000 mgr.y (mgr.25142) 849 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: cluster 2024-09-21T05:41:19.078197+0000 mgr.y (mgr.25142) 850 : cluster [DBG] pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:20.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:20 smithi110 bash[70834]: audit 2024-09-21T05:41:20.472776+0000 mon.b (mon.1) 328 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:21.296 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:22.04961738Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:22 smithi089 bash[91918]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:22 smithi089 bash[91918]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:22 smithi089 bash[88398]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:22 smithi089 bash[88398]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:22 smithi110 bash[70834]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:22 smithi110 bash[70834]: cluster 2024-09-21T05:41:21.079347+0000 mgr.y (mgr.25142) 851 : cluster [DBG] pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:22.873 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)" 2024-09-21T05:41:23.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade status' 2024-09-21T05:41:23.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:23 smithi089 bash[88398]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:23.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:23 smithi089 bash[88398]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:23.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:23 smithi089 bash[91918]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:23.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:23 smithi089 bash[91918]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:23 smithi110 bash[70834]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:23.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:23 smithi110 bash[70834]: audit 2024-09-21T05:41:22.862812+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? 172.21.15.89:0/1442481713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:24.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:24 smithi089 bash[88398]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:24.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:24 smithi089 bash[88398]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:24 smithi089 bash[91918]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:24.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:24 smithi089 bash[91918]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:24 smithi110 bash[70834]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:24.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:24 smithi110 bash[70834]: cluster 2024-09-21T05:41:23.080179+0000 mgr.y (mgr.25142) 852 : cluster [DBG] pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:25.039614922Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:26.509 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:26] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:41:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:26 smithi089 bash[88398]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:26.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:26 smithi089 bash[88398]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:26.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:26 smithi089 bash[91918]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:26.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:26 smithi089 bash[91918]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:26 smithi110 bash[70834]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:26.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:26 smithi110 bash[70834]: cluster 2024-09-21T05:41:25.081864+0000 mgr.y (mgr.25142) 853 : cluster [DBG] pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:28.437 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:28.514 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:28.062097226Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:28 smithi089 bash[88398]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:28.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:28 smithi089 bash[88398]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:28 smithi089 bash[91918]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:28.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:28 smithi089 bash[91918]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:28 smithi110 bash[70834]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:28.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:28 smithi110 bash[70834]: cluster 2024-09-21T05:41:27.082813+0000 mgr.y (mgr.25142) 854 : cluster [DBG] pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:41:30.057 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-21T05:41:30.057 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:41:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:41:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[91918]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[91918]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[91918]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[91918]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[88398]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[88398]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[88398]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:30 smithi089 bash[88398]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:30 smithi110 bash[70834]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:30 smithi110 bash[70834]: audit 2024-09-21T05:41:28.834225+0000 mgr.y (mgr.25142) 855 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:30 smithi110 bash[70834]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:30 smithi110 bash[70834]: cluster 2024-09-21T05:41:29.084173+0000 mgr.y (mgr.25142) 856 : cluster [DBG] pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:30.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph health detail' 2024-09-21T05:41:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:31.022471191Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:31.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:31 smithi089 bash[88398]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:31.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:31 smithi089 bash[88398]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:31.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:31 smithi089 bash[91918]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:31.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:31 smithi089 bash[91918]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:31 smithi110 bash[70834]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:31.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:31 smithi110 bash[70834]: audit 2024-09-21T05:41:30.057411+0000 mgr.y (mgr.25142) 857 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:32.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:32 smithi089 bash[91918]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:32.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:32 smithi089 bash[91918]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:32 smithi089 bash[88398]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:32.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:32 smithi089 bash[88398]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:32 smithi110 bash[70834]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:32.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:32 smithi110 bash[70834]: cluster 2024-09-21T05:41:31.084868+0000 mgr.y (mgr.25142) 858 : cluster [DBG] pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:34.535 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:34.05629118Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:34 smithi089 bash[88398]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:34.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:34 smithi089 bash[88398]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:34.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:34 smithi089 bash[91918]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:34.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:34 smithi089 bash[91918]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:34 smithi110 bash[70834]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:34.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:34 smithi110 bash[70834]: cluster 2024-09-21T05:41:33.085580+0000 mgr.y (mgr.25142) 859 : cluster [DBG] pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:35.649 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:35 smithi110 bash[70834]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:35.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:35 smithi110 bash[70834]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:35.877 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:35 smithi089 bash[91918]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:35.877 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:35 smithi089 bash[91918]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:35.877 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:35 smithi089 bash[88398]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:35.877 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:35 smithi089 bash[88398]: audit 2024-09-21T05:41:35.473290+0000 mon.b (mon.1) 329 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:36] "GET /metrics HTTP/1.1" 200 38328 "" "Prometheus/2.51.0" 2024-09-21T05:41:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:36 smithi110 bash[70834]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:36.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:36 smithi110 bash[70834]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:37.001 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:36 smithi089 bash[88398]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:37.002 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:36 smithi089 bash[88398]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:37.002 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:36 smithi089 bash[91918]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:37.002 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:36 smithi089 bash[91918]: cluster 2024-09-21T05:41:35.087166+0000 mgr.y (mgr.25142) 860 : cluster [DBG] pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:37.424 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-21T05:41:37.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:37.060349917Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:37.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:37 smithi089 bash[88398]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:37.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:37 smithi089 bash[88398]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:37.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:37 smithi089 bash[91918]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:37.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:37 smithi089 bash[91918]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:37 smithi110 bash[70834]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:38.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:37 smithi110 bash[70834]: audit 2024-09-21T05:41:37.424831+0000 mon.a (mon.0) 516 : audit [DBG] from='client.? 172.21.15.89:0/1764465141' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T05:41:38.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.foo' 2024-09-21T05:41:38.845 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:38 smithi089 bash[88398]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:38.845 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:38 smithi089 bash[88398]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:38.846 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:38 smithi089 bash[91918]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:38.846 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:38 smithi089 bash[91918]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:38 smithi110 bash[70834]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:39.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:38 smithi110 bash[70834]: cluster 2024-09-21T05:41:37.087708+0000 mgr.y (mgr.25142) 861 : cluster [DBG] pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:40.039153715Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[88398]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[88398]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[88398]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[88398]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[91918]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[91918]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[91918]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:41.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:40 smithi089 bash[91918]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:40 smithi110 bash[70834]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:40 smithi110 bash[70834]: audit 2024-09-21T05:41:38.845412+0000 mgr.y (mgr.25142) 862 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:40 smithi110 bash[70834]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:41.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:40 smithi110 bash[70834]: cluster 2024-09-21T05:41:39.089006+0000 mgr.y (mgr.25142) 863 : cluster [DBG] pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:42.965 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:42 smithi089 bash[88398]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:42 smithi089 bash[88398]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:42 smithi089 bash[91918]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:42 smithi089 bash[91918]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:42 smithi110 bash[70834]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.047 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:42 smithi110 bash[70834]: cluster 2024-09-21T05:41:41.090223+0000 mgr.y (mgr.25142) 864 : cluster [DBG] pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:43.048915102Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:45.026 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.026 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[88398]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:44 smithi089 bash[91918]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: cluster 2024-09-21T05:41:43.091139+0000 mgr.y (mgr.25142) 865 : cluster [DBG] pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: audit 2024-09-21T05:41:43.998341+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:45.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:44 smithi110 bash[70834]: audit 2024-09-21T05:41:44.006850+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.041 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.042 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.042 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.042 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:45 smithi110 bash[70834]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[91918]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.469962+0000 mgr.y (mgr.25142) 866 : audit [DBG] from='client.54635 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.621387+0000 mon.b (mon.1) 330 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.622730+0000 mon.b (mon.1) 331 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:46.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:45 smithi089 bash[88398]: audit 2024-09-21T05:41:44.632369+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:46.042292236Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:46.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:46] "GET /metrics HTTP/1.1" 200 38328 "" "Prometheus/2.51.0" 2024-09-21T05:41:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:46 smithi089 bash[88398]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:46 smithi089 bash[88398]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:46 smithi089 bash[91918]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:46 smithi089 bash[91918]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:46 smithi110 bash[70834]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:46 smithi110 bash[70834]: cluster 2024-09-21T05:41:45.092650+0000 mgr.y (mgr.25142) 867 : cluster [DBG] pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:47.125 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T05:41:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.296 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[88398]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.297 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:48 smithi089 bash[91918]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cluster 2024-09-21T05:41:47.093268+0000 mgr.y (mgr.25142) 868 : cluster [DBG] pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cephadm 2024-09-21T05:41:47.115343+0000 mgr.y (mgr.25142) 869 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.124146+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.129056+0000 mon.b (mon.1) 332 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.130842+0000 mon.b (mon.1) 333 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: audit 2024-09-21T05:41:47.140570+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:48.555 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:48 smithi110 bash[70834]: cephadm 2024-09-21T05:41:47.212053+0000 mgr.y (mgr.25142) 870 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 2024-09-21T05:41:49.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:49.062635602Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.799 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.800 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[88398]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.801 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:50.802 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:50 smithi089 bash[91918]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:48.854088+0000 mgr.y (mgr.25142) 871 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: cluster 2024-09-21T05:41:49.094033+0000 mgr.y (mgr.25142) 872 : cluster [DBG] pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.921726+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.928049+0000 mon.b (mon.1) 334 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.931666+0000 mon.b (mon.1) 335 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.938350+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.945307+0000 mon.b (mon.1) 336 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.951589+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.958378+0000 mon.b (mon.1) 337 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.964725+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.972366+0000 mon.b (mon.1) 338 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.982480+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:49.991132+0000 mon.b (mon.1) 339 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.806 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:50.002113+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:50.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:50.807 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:50 smithi110 bash[70834]: audit 2024-09-21T05:41:50.473365+0000 mon.b (mon.1) 340 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:41:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:51.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[91918]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:51.798 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:51 smithi089 bash[88398]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.924359+0000 mgr.y (mgr.25142) 873 : cephadm [INF] Upgrade: Target is version 19.3.0-5103-gf36283e7 (squid) 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.924453+0000 mgr.y (mgr.25142) 874 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2195e5f178be0a9390728e2a14088236d8fe6f82635f5c84418fe37a04457e00'] 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.932525+0000 mgr.y (mgr.25142) 875 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-09-21T05:41:51.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.946058+0000 mgr.y (mgr.25142) 876 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.959300+0000 mgr.y (mgr.25142) 877 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.973280+0000 mgr.y (mgr.25142) 878 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:51.805 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:51 smithi110 bash[70834]: cephadm 2024-09-21T05:41:49.992344+0000 mgr.y (mgr.25142) 879 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-09-21T05:41:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:52.022998208Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:52.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:52 smithi089 bash[91918]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:52.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:52 smithi089 bash[91918]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:52 smithi089 bash[88398]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:52.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:52 smithi089 bash[88398]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:52 smithi110 bash[70834]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:52 smithi110 bash[70834]: cluster 2024-09-21T05:41:51.095163+0000 mgr.y (mgr.25142) 880 : cluster [DBG] pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:54.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[88398]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:53 smithi089 bash[91918]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: cephadm 2024-09-21T05:41:52.613120+0000 mgr.y (mgr.25142) 881 : cephadm [INF] Upgrade: Updating rgw.foo.smithi089.siazst (1/2) 2024-09-21T05:41:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.620337+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:41:54.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.627676+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.627714+0000 mon.b (mon.1) 341 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi089.siazst", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: audit 2024-09-21T05:41:52.632938+0000 mon.b (mon.1) 342 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:53 smithi110 bash[70834]: cephadm 2024-09-21T05:41:52.634271+0000 mgr.y (mgr.25142) 882 : cephadm [INF] Deploying daemon rgw.foo.smithi089.siazst on smithi089 2024-09-21T05:41:54.103 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:41:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:54 smithi089 bash[88398]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:54 smithi089 bash[88398]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:54 smithi089 bash[91918]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:54 smithi089 bash[91918]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:54 smithi110 bash[70834]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:54 smithi110 bash[70834]: cluster 2024-09-21T05:41:53.095995+0000 mgr.y (mgr.25142) 883 : cluster [DBG] pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:55.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:55.06251805Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:56.039 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:41:56.462 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.462 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.463 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.463 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.463 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:41:56] "GET /metrics HTTP/1.1" 200 38329 "" "Prometheus/2.51.0" 2024-09-21T05:41:56.463 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.464 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.464 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.464 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.464 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:41:56 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:41:56.662 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:41:56.662 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (14m) 4m ago 41m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:41:56.662 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (13m) 85s ago 41m 70.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (16m) 4m ago 38m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (15m) 85s ago 49m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (26m) 4m ago 52m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (10m) 4m ago 52m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (12m) 85s ago 50m 48.4M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (10m) 4m ago 50m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (15m) 4m ago 41m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (15m) 85s ago 41m 8544k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 4m ago 49m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (7m) 4m ago 48m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 4m ago 47m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 4m ago 46m - 3036M 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (3m) 85s ago 45m 52.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:41:56.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (2m) 85s ago 44m 53.9M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:41:56.664 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (2m) 85s ago 43m 48.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 9503bc5aac84 2024-09-21T05:41:56.664 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running 85s ago 42m - 3292M 2024-09-21T05:41:56.664 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (14m) 85s ago 41m 54.5M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:41:56.664 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (39m) 4m ago 39m 102M - 19.1.1-373-g4e45e6b4 164465d2334a 8cb5b542f9b9 2024-09-21T05:41:56.664 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (39m) 85s ago 39m 103M - 19.1.1-373-g4e45e6b4 164465d2334a e34d78398826 2024-09-21T05:41:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:56 smithi089 bash[91918]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:56.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:56 smithi089 bash[91918]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:56 smithi089 bash[88398]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:56 smithi089 bash[88398]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:41:57.005 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 8 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 13 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:41:57.006 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:41:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:56 smithi110 bash[70834]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:57.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:56 smithi110 bash[70834]: cluster 2024-09-21T05:41:55.097518+0000 mgr.y (mgr.25142) 884 : cluster [DBG] pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:41:57.306 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:41:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:41:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:41:57.306 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons in service(s) rgw.foo", 2024-09-21T05:41:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:41:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T05:41:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading rgw daemons", 2024-09-21T05:41:57.307 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:41:57.307 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:57 smithi110 bash[70834]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[88398]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.026941+0000 mgr.y (mgr.25142) 885 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.354216+0000 mgr.y (mgr.25142) 886 : audit [DBG] from='client.54647 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:56.650237+0000 mgr.y (mgr.25142) 887 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:57 smithi089 bash[91918]: audit 2024-09-21T05:41:57.005856+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.15.89:0/322093183' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:41:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:41:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:41:58.044236061Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:41:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[88398]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[88398]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[88398]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[88398]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[91918]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[91918]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[91918]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:41:58 smithi089 bash[91918]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:58 smithi110 bash[70834]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:58 smithi110 bash[70834]: cluster 2024-09-21T05:41:57.097994+0000 mgr.y (mgr.25142) 888 : cluster [DBG] pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:58 smithi110 bash[70834]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:41:59.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:41:58 smithi110 bash[70834]: audit 2024-09-21T05:41:57.306388+0000 mgr.y (mgr.25142) 889 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[88398]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[88398]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[88398]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[88398]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[91918]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[91918]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[91918]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:00 smithi089 bash[91918]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:00 smithi110 bash[70834]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:00 smithi110 bash[70834]: audit 2024-09-21T05:41:58.862158+0000 mgr.y (mgr.25142) 890 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:00 smithi110 bash[70834]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:00 smithi110 bash[70834]: cluster 2024-09-21T05:41:59.099316+0000 mgr.y (mgr.25142) 891 : cluster [DBG] pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:01.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:01.05964664Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:02 smithi089 bash[88398]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:03.049 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:02 smithi089 bash[88398]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:03.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:02 smithi089 bash[91918]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:03.050 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:02 smithi089 bash[91918]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:02 smithi110 bash[70834]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:03.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:02 smithi110 bash[70834]: cluster 2024-09-21T05:42:01.100457+0000 mgr.y (mgr.25142) 892 : cluster [DBG] pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:04.021656865Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:04 smithi089 bash[88398]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:04 smithi089 bash[88398]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:04 smithi089 bash[91918]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:04 smithi089 bash[91918]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:04 smithi110 bash[70834]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:05.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:04 smithi110 bash[70834]: cluster 2024-09-21T05:42:03.101349+0000 mgr.y (mgr.25142) 893 : cluster [DBG] pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:05 smithi089 bash[88398]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:05 smithi089 bash[88398]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:05 smithi089 bash[91918]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:05 smithi089 bash[91918]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:05 smithi110 bash[70834]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:05 smithi110 bash[70834]: audit 2024-09-21T05:42:05.474037+0000 mon.b (mon.1) 343 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:06] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:42:06.828 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:06 smithi089 bash[91918]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:06.828 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:06 smithi089 bash[91918]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:06.828 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:06 smithi089 bash[88398]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:06.829 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:06 smithi089 bash[88398]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:07.043 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:06 smithi110 bash[70834]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:07.044 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:06 smithi110 bash[70834]: cluster 2024-09-21T05:42:05.102938+0000 mgr.y (mgr.25142) 894 : cluster [DBG] pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:42:07.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:07.044647137Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.797 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.797 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.798 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.798 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.798 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:07.798 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:42:07 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[88398]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.027 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.028 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.028 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:08 smithi089 bash[91918]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: cluster 2024-09-21T05:42:07.103817+0000 mgr.y (mgr.25142) 895 : cluster [DBG] pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: audit 2024-09-21T05:42:07.659959+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:09.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:08 smithi110 bash[70834]: audit 2024-09-21T05:42:07.671152+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:10.054156568Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[88398]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:10 smithi089 bash[91918]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:08.869997+0000 mgr.y (mgr.25142) 896 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: cluster 2024-09-21T05:42:09.104765+0000 mgr.y (mgr.25142) 897 : cluster [DBG] pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.332493+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.338580+0000 mon.b (mon.1) 344 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.338720+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi110.bcgqia", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.055 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:10 smithi110 bash[70834]: audit 2024-09-21T05:42:10.345213+0000 mon.b (mon.1) 345 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:11.949 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:11 smithi110 bash[70834]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:11.949 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:11 smithi110 bash[70834]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:11.949 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:11 smithi110 bash[70834]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:11.949 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:11 smithi110 bash[70834]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[88398]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:12.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[88398]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[88398]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[88398]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[91918]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[91918]: cephadm 2024-09-21T05:42:10.324192+0000 mgr.y (mgr.25142) 898 : cephadm [INF] Upgrade: Updating rgw.foo.smithi110.bcgqia (2/2) 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[91918]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:12.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:11 smithi089 bash[91918]: cephadm 2024-09-21T05:42:10.346768+0000 mgr.y (mgr.25142) 899 : cephadm [INF] Deploying daemon rgw.foo.smithi110.bcgqia on smithi110 2024-09-21T05:42:12.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:12 smithi110 bash[70834]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:12.961 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:12 smithi110 bash[70834]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:12 smithi089 bash[88398]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:13.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:12 smithi089 bash[88398]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:12 smithi089 bash[91918]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:13.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:12 smithi089 bash[91918]: cluster 2024-09-21T05:42:11.105899+0000 mgr.y (mgr.25142) 900 : cluster [DBG] pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:13.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.305 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.305 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.305 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.306 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.306 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:13.306 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:13.058069885Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:13.306 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:42:12 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:15.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:14 smithi089 bash[88398]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:15.068 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:14 smithi089 bash[88398]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:15.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:14 smithi089 bash[91918]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:15.068 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:14 smithi089 bash[91918]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:15.069 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:14 smithi110 bash[70834]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:15.069 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:14 smithi110 bash[70834]: cluster 2024-09-21T05:42:13.106777+0000 mgr.y (mgr.25142) 901 : cluster [DBG] pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 85 B/s wr, 65 op/s 2024-09-21T05:42:16.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:16] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:42:16.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:16.063459453Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:17.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:16 smithi089 bash[88398]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:17.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:16 smithi089 bash[88398]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:16 smithi089 bash[91918]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:17.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:16 smithi089 bash[91918]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:16 smithi110 bash[70834]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:17.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:16 smithi110 bash[70834]: cluster 2024-09-21T05:42:15.108371+0000 mgr.y (mgr.25142) 902 : cluster [DBG] pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:18 smithi089 bash[88398]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:18 smithi089 bash[88398]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:18 smithi089 bash[91918]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:18 smithi089 bash[91918]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:18 smithi110 bash[70834]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:18 smithi110 bash[70834]: cluster 2024-09-21T05:42:17.109322+0000 mgr.y (mgr.25142) 903 : cluster [DBG] pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:19.05444346Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[88398]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:21.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:20 smithi089 bash[91918]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: audit 2024-09-21T05:42:18.880938+0000 mgr.y (mgr.25142) 904 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: cluster 2024-09-21T05:42:19.110757+0000 mgr.y (mgr.25142) 905 : cluster [DBG] pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:21.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:20 smithi110 bash[70834]: audit 2024-09-21T05:42:20.474232+0000 mon.b (mon.1) 346 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:22.041449123Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:22 smithi089 bash[88398]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:23.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:22 smithi089 bash[88398]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:22 smithi089 bash[91918]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:23.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:22 smithi089 bash[91918]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:22 smithi110 bash[70834]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:23.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:22 smithi110 bash[70834]: cluster 2024-09-21T05:42:21.111897+0000 mgr.y (mgr.25142) 906 : cluster [DBG] pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:42:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.305 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:42:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.305 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.305 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:42:24 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:24.306 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:42:23 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:42:25.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.029 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.030 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:24 smithi110 bash[70834]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[88398]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: cluster 2024-09-21T05:42:23.112812+0000 mgr.y (mgr.25142) 907 : cluster [DBG] pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: audit 2024-09-21T05:42:24.164459+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:24 smithi089 bash[91918]: audit 2024-09-21T05:42:24.176287+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:25.030301922Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:26.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:26 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:26] "GET /metrics HTTP/1.1" 200 38312 "" "Prometheus/2.51.0" 2024-09-21T05:42:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:26 smithi089 bash[88398]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:26 smithi089 bash[88398]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:26 smithi089 bash[91918]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:26 smithi089 bash[91918]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:26 smithi110 bash[70834]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:26 smithi110 bash[70834]: cluster 2024-09-21T05:42:25.114396+0000 mgr.y (mgr.25142) 908 : cluster [DBG] pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-21T05:42:27.644 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-21T05:42:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:42:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (14m) 4m ago 41m 14.2M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:42:28.302 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (14m) 117s ago 41m 70.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (16m) 4m ago 39m 49.1M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (16m) 117s ago 50m 446M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (27m) 4m ago 52m 518M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (11m) 4m ago 52m 53.1M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (12m) 117s ago 50m 48.4M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (10m) 4m ago 50m 38.3M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (16m) 4m ago 42m 9079k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (16m) 117s ago 42m 8544k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:42:28.303 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 4m ago 49m 49.6M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (8m) 4m ago 48m 51.4M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6m) 4m ago 47m 47.5M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running 4m ago 46m - 3036M 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (4m) 117s ago 46m 52.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (3m) 117s ago 45m 53.9M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (2m) 117s ago 44m 48.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 9503bc5aac84 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running 117s ago 43m - 3292M 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (15m) 117s ago 42m 54.5M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:42:28.304 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 starting - - - - 2024-09-21T05:42:28.305 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 starting - - - - 2024-09-21T05:42:28.305 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:28.034457916Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 3 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-21T05:42:28.680 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 8 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw": { 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:42:28.681 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 2 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.3.0-5103-gf36283e7 (f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2) squid (dev)": 15 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-21T05:42:28.682 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2", 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading daemons in service(s) rgw.foo", 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading rgw daemons", 2024-09-21T05:42:29.001 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-21T05:42:29.002 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-21T05:42:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[88398]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:29.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:28 smithi089 bash[91918]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: cluster 2024-09-21T05:42:27.115382+0000 mgr.y (mgr.25142) 909 : cluster [DBG] pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 255 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: audit 2024-09-21T05:42:27.632989+0000 mgr.y (mgr.25142) 910 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:29.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:28 smithi110 bash[70834]: audit 2024-09-21T05:42:28.680111+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.89:0/3635738258' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[91918]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[91918]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.046 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[91918]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[91918]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[88398]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[88398]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[88398]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:29 smithi089 bash[88398]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.053 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:29 smithi110 bash[70834]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:29 smithi110 bash[70834]: audit 2024-09-21T05:42:27.954088+0000 mgr.y (mgr.25142) 911 : audit [DBG] from='client.54716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:29 smithi110 bash[70834]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:30.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:29 smithi110 bash[70834]: audit 2024-09-21T05:42:28.267015+0000 mgr.y (mgr.25142) 912 : audit [DBG] from='client.44748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.039 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.040 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:30 smithi110 bash[70834]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[88398]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:28.890123+0000 mgr.y (mgr.25142) 913 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.001155+0000 mgr.y (mgr.25142) 914 : audit [DBG] from='client.54734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.048 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: cluster 2024-09-21T05:42:29.116797+0000 mgr.y (mgr.25142) 915 : cluster [DBG] pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 85 B/s wr, 82 op/s 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.845750+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:29.851665+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:30.039174+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.049 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:30 smithi089 bash[91918]: audit 2024-09-21T05:42:30.050277+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:31.039895804Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[88398]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.298 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:31 smithi089 bash[91918]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:30.953856+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:30.962702+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: cluster 2024-09-21T05:42:31.118005+0000 mgr.y (mgr.25142) 916 : cluster [DBG] pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:32.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:31.152271+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:32.305 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:31 smithi110 bash[70834]: audit 2024-09-21T05:42:31.163939+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:34.049990879Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:34 smithi110 bash[70834]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:34.304 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:34 smithi110 bash[70834]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:34.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:34 smithi089 bash[88398]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:34.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:34 smithi089 bash[88398]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:34.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:34 smithi089 bash[91918]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:34.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:34 smithi089 bash[91918]: cluster 2024-09-21T05:42:33.118950+0000 mgr.y (mgr.25142) 917 : cluster [DBG] pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:36] "GET /metrics HTTP/1.1" 200 38334 "" "Prometheus/2.51.0" 2024-09-21T05:42:36.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[88398]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[88398]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[88398]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[88398]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[91918]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[91918]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[91918]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:36.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:36 smithi089 bash[91918]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:36.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:36 smithi110 bash[70834]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:36 smithi110 bash[70834]: cluster 2024-09-21T05:42:35.120571+0000 mgr.y (mgr.25142) 918 : cluster [DBG] pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:36.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:36 smithi110 bash[70834]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:36.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:36 smithi110 bash[70834]: audit 2024-09-21T05:42:35.474686+0000 mon.b (mon.1) 347 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:37.290 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:37.038584136Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:38.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:38 smithi089 bash[88398]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:38.546 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:38 smithi089 bash[88398]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:38.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:38 smithi089 bash[91918]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:38.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:38 smithi089 bash[91918]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:38.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:38 smithi110 bash[70834]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:38.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:38 smithi110 bash[70834]: cluster 2024-09-21T05:42:37.121463+0000 mgr.y (mgr.25142) 919 : cluster [DBG] pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.281 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:40.023466715Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:40.281 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:40 smithi110 bash[70834]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.281 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:40 smithi110 bash[70834]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.281 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:40 smithi110 bash[70834]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.281 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:40 smithi110 bash[70834]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.481 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[91918]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[91918]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[91918]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[91918]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[88398]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[88398]: audit 2024-09-21T05:42:38.898176+0000 mgr.y (mgr.25142) 920 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[88398]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:40.482 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:40 smithi089 bash[88398]: cluster 2024-09-21T05:42:39.122866+0000 mgr.y (mgr.25142) 921 : cluster [DBG] pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 85 B/s wr, 124 op/s 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.297 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.298 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.299 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.300 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.301 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.302 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.303 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.304 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.305 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.306 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.307 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.308 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.309 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[91918]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.310 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:41 smithi089 bash[88398]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.311 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.312 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.313 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.314 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.315 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.316 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.317 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.318 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.319 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.320 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.321 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.322 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.323 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.324 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[88398]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.325 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.326 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.327 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.328 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.329 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.330 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:42 smithi089 bash[91918]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:40.982978+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:40.996631+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.049114+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.331 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.063541+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.067568+0000 mon.b (mon.1) 348 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.069644+0000 mon.b (mon.1) 349 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.080720+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cluster 2024-09-21T05:42:41.127451+0000 mgr.y (mgr.25142) 922 : cluster [DBG] pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 43 op/s 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.206544+0000 mon.b (mon.1) 350 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.210289+0000 mon.b (mon.1) 351 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.213459+0000 mon.b (mon.1) 352 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.332 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.215886+0000 mon.b (mon.1) 353 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.219119+0000 mon.b (mon.1) 354 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.223347+0000 mon.b (mon.1) 355 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.226994+0000 mon.b (mon.1) 356 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.228356+0000 mgr.y (mgr.25142) 923 : cephadm [WRN] Upgrade: 2 rgw daemon(s) are 19.1.1-373-g4e45e6b4 != target 19.3.0-5103-gf36283e7 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.228511+0000 mgr.y (mgr.25142) 924 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.236260+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.333 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.241523+0000 mon.b (mon.1) 357 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.241828+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.250107+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi089.siazst"}]': finished 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.255230+0000 mon.b (mon.1) 358 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.255525+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.263141+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi110.bcgqia"}]': finished 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.269628+0000 mon.b (mon.1) 359 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.334 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.270998+0000 mgr.y (mgr.25142) 925 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.280427+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.286966+0000 mon.b (mon.1) 360 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.290343+0000 mon.b (mon.1) 361 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.291522+0000 mgr.y (mgr.25142) 926 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.300789+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.307966+0000 mon.b (mon.1) 362 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.335 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.309093+0000 mgr.y (mgr.25142) 927 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.318027+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.326968+0000 mon.b (mon.1) 363 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.328274+0000 mgr.y (mgr.25142) 928 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.337578+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.346178+0000 mon.b (mon.1) 364 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:41 smithi110 bash[70834]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.350224+0000 mon.b (mon.1) 365 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.354261+0000 mon.b (mon.1) 366 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.336 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.358225+0000 mon.b (mon.1) 367 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.361668+0000 mon.b (mon.1) 368 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.365258+0000 mon.b (mon.1) 369 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.366609+0000 mgr.y (mgr.25142) 929 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.371112+0000 mon.b (mon.1) 370 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.371186+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.379286+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.385663+0000 mon.b (mon.1) 371 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.337 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.385765+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.393469+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.399800+0000 mon.b (mon.1) 372 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.399841+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.407676+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.413902+0000 mon.b (mon.1) 373 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.413955+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T05:42:42.338 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.420123+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.425138+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.425144+0000 mon.b (mon.1) 374 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.431001+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.435917+0000 mon.b (mon.1) 375 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.435951+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.441981+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.339 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.447095+0000 mon.b (mon.1) 376 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.447207+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.453175+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.458313+0000 mon.b (mon.1) 377 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.458398+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.461451+0000 mon.b (mon.1) 378 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.461530+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.467484+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.472711+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.340 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.472712+0000 mon.b (mon.1) 379 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.475870+0000 mon.b (mon.1) 380 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.476072+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.482371+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.487485+0000 mon.b (mon.1) 381 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.487594+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.493820+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.499019+0000 mon.b (mon.1) 382 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.341 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.499041+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.502176+0000 mon.b (mon.1) 383 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.502377+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.505457+0000 mon.b (mon.1) 384 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.505467+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.508170+0000 mon.b (mon.1) 385 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.508354+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.342 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.511217+0000 mon.b (mon.1) 386 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.511377+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.514352+0000 mon.b (mon.1) 387 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.514526+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.516467+0000 mgr.y (mgr.25142) 930 : cephadm [INF] Upgrade: Complete! 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.518134+0000 mon.b (mon.1) 388 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.518208+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.524399+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.25142 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T05:42:42.343 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.527608+0000 mon.b (mon.1) 389 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.529432+0000 mon.b (mon.1) 390 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: cephadm 2024-09-21T05:42:41.540217+0000 mgr.y (mgr.25142) 931 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.853179+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.959038+0000 mon.b (mon.1) 391 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.961217+0000 mon.b (mon.1) 392 : audit [INF] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:42.344 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:42 smithi110 bash[70834]: audit 2024-09-21T05:42:41.970749+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:43.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:43.0587629Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:44.546 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:44 smithi089 bash[91918]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:44.547 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:44 smithi089 bash[91918]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:44.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:44 smithi089 bash[88398]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:44.547 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:44 smithi089 bash[88398]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:44.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:44 smithi110 bash[70834]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:44.554 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:44 smithi110 bash[70834]: cluster 2024-09-21T05:42:43.128632+0000 mgr.y (mgr.25142) 932 : cluster [DBG] pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-21T05:42:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:46.048264445Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:46.510 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:46] "GET /metrics HTTP/1.1" 200 38334 "" "Prometheus/2.51.0" 2024-09-21T05:42:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[88398]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[88398]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[88398]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:46.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[88398]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[91918]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[91918]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[91918]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:46.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:46 smithi089 bash[91918]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:46 smithi110 bash[70834]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:46 smithi110 bash[70834]: cluster 2024-09-21T05:42:45.130319+0000 mgr.y (mgr.25142) 933 : cluster [DBG] pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-21T05:42:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:46 smithi110 bash[70834]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:46.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:46 smithi110 bash[70834]: audit 2024-09-21T05:42:45.875466+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.25142 ' entity='mgr.y' 2024-09-21T05:42:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:48 smithi089 bash[88398]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:48.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:48 smithi089 bash[88398]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:48.796 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:48 smithi089 bash[91918]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:48.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:48 smithi089 bash[91918]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:48 smithi110 bash[70834]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:48.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:48 smithi110 bash[70834]: cluster 2024-09-21T05:42:47.131213+0000 mgr.y (mgr.25142) 934 : cluster [DBG] pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:49.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:49.059645487Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:50.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[88398]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:50.798 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:50 smithi089 bash[91918]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: audit 2024-09-21T05:42:48.909477+0000 mgr.y (mgr.25142) 935 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: cluster 2024-09-21T05:42:49.132662+0000 mgr.y (mgr.25142) 936 : cluster [DBG] pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:50.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:50 smithi110 bash[70834]: audit 2024-09-21T05:42:50.475525+0000 mon.b (mon.1) 393 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:42:52.524 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:52.069043174Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:52 smithi089 bash[88398]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:52.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:52 smithi089 bash[88398]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:52 smithi089 bash[91918]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:52.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:52 smithi089 bash[91918]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:52 smithi110 bash[70834]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:52.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:52 smithi110 bash[70834]: cluster 2024-09-21T05:42:51.133848+0000 mgr.y (mgr.25142) 937 : cluster [DBG] pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-21T05:42:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:54 smithi089 bash[88398]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:54.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:54 smithi089 bash[88398]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:54 smithi089 bash[91918]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:54.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:54 smithi089 bash[91918]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:54 smithi110 bash[70834]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:54.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:54 smithi110 bash[70834]: cluster 2024-09-21T05:42:53.134766+0000 mgr.y (mgr.25142) 938 : cluster [DBG] pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-21T05:42:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:55.028866812Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:56.532 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:42:56 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:42:56] "GET /metrics HTTP/1.1" 200 38330 "" "Prometheus/2.51.0" 2024-09-21T05:42:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:56 smithi089 bash[88398]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:56.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:56 smithi089 bash[88398]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:56.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:56 smithi089 bash[91918]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:56.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:56 smithi089 bash[91918]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:56 smithi110 bash[70834]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:56.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:56 smithi110 bash[70834]: cluster 2024-09-21T05:42:55.136307+0000 mgr.y (mgr.25142) 939 : cluster [DBG] pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-21T05:42:58.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:42:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:42:58.049019641Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:42:58.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:58 smithi089 bash[88398]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:42:58.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:42:58 smithi089 bash[88398]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:42:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:58 smithi089 bash[91918]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:42:58.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:42:58 smithi089 bash[91918]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:42:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:58 smithi110 bash[70834]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:42:58.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:42:58 smithi110 bash[70834]: cluster 2024-09-21T05:42:57.137140+0000 mgr.y (mgr.25142) 940 : cluster [DBG] pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-21T05:43:00.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph orch ps' 2024-09-21T05:43:00.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[88398]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:00 smithi089 bash[91918]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: audit 2024-09-21T05:42:58.918772+0000 mgr.y (mgr.25142) 941 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: cluster 2024-09-21T05:42:59.137895+0000 mgr.y (mgr.25142) 942 : cluster [DBG] pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:00.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:00 smithi110 bash[70834]: audit 2024-09-21T05:42:59.335206+0000 mgr.y (mgr.25142) 943 : audit [DBG] from='client.54776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:01.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:01.022730864Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:02 smithi089 bash[88398]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:02.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:02 smithi089 bash[88398]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:02 smithi089 bash[91918]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:02.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:02 smithi089 bash[91918]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:02 smithi110 bash[70834]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:02.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:02 smithi110 bash[70834]: cluster 2024-09-21T05:43:01.138995+0000 mgr.y (mgr.25142) 944 : cluster [DBG] pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:04.549 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:04.058298537Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:04 smithi110 bash[70834]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:04.804 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:04 smithi110 bash[70834]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:04 smithi089 bash[88398]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:05.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:04 smithi089 bash[88398]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:04 smithi089 bash[91918]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:05.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:04 smithi089 bash[91918]: cluster 2024-09-21T05:43:03.139941+0000 mgr.y (mgr.25142) 945 : cluster [DBG] pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:05.070 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:06.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:05 smithi089 bash[88398]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:05 smithi089 bash[88398]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:05 smithi089 bash[91918]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:05 smithi089 bash[91918]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:05 smithi110 bash[70834]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:05 smithi110 bash[70834]: audit 2024-09-21T05:43:05.475441+0000 mon.b (mon.1) 394 : audit [DBG] from='mgr.25142 172.21.15.89:0/1305067757' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T05:43:06.546 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:43:06 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:43:06] "GET /metrics HTTP/1.1" 200 38332 "" "Prometheus/2.51.0" 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.a smithi089 *:9093,9094 running (15m) 36s ago 42m 14.3M - 0.27.0 11f11916f8cd b88d0ee1e234 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.a smithi110 *:3000 running (14m) 36s ago 42m 69.0M - 10.4.8 5aad1d7cf004 044bbbaf4a3c 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:iscsi.foo.smithi089.vkfkma smithi089 *:5000 running (17m) 36s ago 40m 49.4M - 3.8 164465d2334a 5a642c1e7b07 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.x smithi110 *:8443,9283,8765 running (17m) 36s ago 50m 447M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 4c50ba96dbd9 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.y smithi089 *:8443,9283,8765 running (27m) 36s ago 53m 522M - 19.3.0-5103-gf36283e7 48ed0a2cf89d 99c0288bca20 2024-09-21T05:43:06.773 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a smithi089 running (11m) 36s ago 53m 64.5M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 3cafa6a700c1 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b smithi110 running (13m) 36s ago 51m 52.2M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 4cffa9fc993c 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c smithi089 running (11m) 36s ago 51m 43.5M 2048M 19.3.0-5103-gf36283e7 48ed0a2cf89d 710a3aa69a2a 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.a smithi089 *:9100 running (16m) 36s ago 42m 8563k - 1.7.0 72c9c2088986 e4b97345c3d5 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.b smithi110 *:9100 running (16m) 36s ago 42m 8739k - 1.7.0 72c9c2088986 50bde8f724f7 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (9m) 36s ago 50m 58.8M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d f29e4723cf37 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (8m) 36s ago 49m 61.7M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 7ccdc3052ae0 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (7m) 36s ago 48m 54.1M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 5613f06d7f98 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi089 running (5m) 36s ago 47m 55.9M 3036M 19.3.0-5103-gf36283e7 48ed0a2cf89d 8d189cd685fd 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi110 running (4m) 36s ago 46m 58.2M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 88a4447cc5af 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi110 running (4m) 36s ago 45m 58.6M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d d7f60613af5f 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.6 smithi110 running (3m) 36s ago 44m 52.5M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 9503bc5aac84 2024-09-21T05:43:06.774 INFO:teuthology.orchestra.run.smithi089.stdout:osd.7 smithi110 running (2m) 36s ago 43m 53.3M 3292M 19.3.0-5103-gf36283e7 48ed0a2cf89d 8827cb4d384a 2024-09-21T05:43:06.775 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.a smithi110 *:9095 running (16m) 36s ago 43m 55.0M - 2.51.0 1d3b7f56885b f9862e836323 2024-09-21T05:43:06.775 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi089.siazst smithi089 *:8000 running (59s) 36s ago 40m 90.2M - 19.3.0-5103-gf36283e7 48ed0a2cf89d fdf5b8f48532 2024-09-21T05:43:06.775 INFO:teuthology.orchestra.run.smithi089.stdout:rgw.foo.smithi110.bcgqia smithi110 *:8000 running (42s) 36s ago 40m 89.9M - 19.3.0-5103-gf36283e7 48ed0a2cf89d d238e76dae37 2024-09-21T05:43:06.812 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:06 smithi089 bash[88398]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:06.813 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:06 smithi089 bash[88398]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:06.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:06 smithi089 bash[91918]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:06.813 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:06 smithi089 bash[91918]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:06 smithi110 bash[70834]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:07.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:06 smithi110 bash[70834]: cluster 2024-09-21T05:43:05.141532+0000 mgr.y (mgr.25142) 946 : cluster [DBG] pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:07.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c 'ceph versions | jq -e '"'"'.rgw | length == 1'"'"'' 2024-09-21T05:43:07.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:07.056938856Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:07 smithi089 bash[88398]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:07.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:07 smithi089 bash[88398]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:07.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:07 smithi089 bash[91918]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:07.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:07 smithi089 bash[91918]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:07 smithi110 bash[70834]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:08.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:07 smithi110 bash[70834]: audit 2024-09-21T05:43:06.735979+0000 mgr.y (mgr.25142) 947 : audit [DBG] from='client.54782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T05:43:08.926 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:08 smithi089 bash[88398]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:08.926 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:08 smithi089 bash[88398]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:08.926 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:08 smithi089 bash[91918]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:08.926 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:08 smithi089 bash[91918]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:08 smithi110 bash[70834]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:09.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:08 smithi110 bash[70834]: cluster 2024-09-21T05:43:07.142456+0000 mgr.y (mgr.25142) 948 : cluster [DBG] pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:10.036237389Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[88398]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.046 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[88398]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[88398]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[88398]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[91918]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[91918]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[91918]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:11.047 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:10 smithi089 bash[91918]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:10 smithi110 bash[70834]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:10 smithi110 bash[70834]: audit 2024-09-21T05:43:08.926253+0000 mgr.y (mgr.25142) 949 : audit [DBG] from='client.25322 -' entity='client.iscsi.foo.smithi089.vkfkma' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-21T05:43:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:10 smithi110 bash[70834]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:11.054 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:10 smithi110 bash[70834]: cluster 2024-09-21T05:43:09.143910+0000 mgr.y (mgr.25142) 950 : cluster [DBG] pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:12.367 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T05:43:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:12 smithi089 bash[88398]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:12.796 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:12 smithi089 bash[88398]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:12 smithi089 bash[91918]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:12.797 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:12 smithi089 bash[91918]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:13.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:12 smithi110 bash[70834]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:13.048 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:12 smithi110 bash[70834]: cluster 2024-09-21T05:43:11.145082+0000 mgr.y (mgr.25142) 951 : cluster [DBG] pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T05:43:13.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:13.049394374Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:14.070 INFO:teuthology.orchestra.run.smithi089.stdout:false 2024-09-21T05:43:14.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:43:14.749 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa/tasks/cephadm.py", line 1525, in shell _shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa/tasks/cephadm.py", line 111, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\'' 2024-09-21T05:43:14.917 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=94a2f0c3b77f45439ca5cf44f0efa99b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa/tasks/cephadm.py", line 1525, in shell _shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2/qa/tasks/cephadm.py", line 111, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c \'ceph versions | jq -e \'"\'"\'.rgw | length == 1\'"\'"\'\'' 2024-09-21T05:43:14.920 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T05:43:14.972 INFO:tasks.cephadm:Teardown begin 2024-09-21T05:43:14.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:14.986 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[88398]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:14.986 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[88398]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:14.986 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[88398]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:14.986 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[88398]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:14.987 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[91918]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:14.987 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[91918]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:14.987 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[91918]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:14.987 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:14 smithi089 bash[91918]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:14.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:43:15.000 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:14 smithi110 bash[70834]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:15.000 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:14 smithi110 bash[70834]: cluster 2024-09-21T05:43:13.146062+0000 mgr.y (mgr.25142) 952 : cluster [DBG] pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 259 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-21T05:43:15.000 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:14 smithi110 bash[70834]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:15.001 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:14 smithi110 bash[70834]: audit 2024-09-21T05:43:14.058936+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? 172.21.15.89:0/3041397874' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T05:43:15.003 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T05:43:15.003 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:43:15.037 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T05:43:15.050 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T05:43:15.050 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T05:43:15.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a 2024-09-21T05:43:15.380 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:15 smithi089 systemd[1]: Stopping Ceph mon.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:15.381 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:15 smithi089 bash[88398]: debug 2024-09-21T05:43:15.220+0000 7fae159ed640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:43:15.381 INFO:journalctl@ceph.mon.a.smithi089.stdout:Sep 21 05:43:15 smithi089 bash[88398]: debug 2024-09-21T05:43:15.220+0000 7fae159ed640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T05:43:16.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T05:43:16.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:16.039078039Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:16.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:16.335 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T05:43:16.335 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-21T05:43:16.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.c 2024-09-21T05:43:16.388 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:43:16 smithi089 bash[68019]: ::ffff:172.21.15.110 - - [21/Sep/2024:05:43:16] "GET /metrics HTTP/1.1" 200 38332 "" "Prometheus/2.51.0" 2024-09-21T05:43:16.565 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:16 smithi089 systemd[1]: Stopping Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:16.565 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:16 smithi089 bash[91918]: debug 2024-09-21T05:43:16.516+0000 7f1580133640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:43:16.565 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:16 smithi089 bash[91918]: debug 2024-09-21T05:43:16.516+0000 7f1580133640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:43:17.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T05:43:17.412 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:17 smithi089 bash[124652]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-c 2024-09-21T05:43:17.412 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:17 smithi089 bash[124713]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-mon-c 2024-09-21T05:43:17.412 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:17 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.c.service: Deactivated successfully. 2024-09-21T05:43:17.412 INFO:journalctl@ceph.mon.c.smithi089.stdout:Sep 21 05:43:17 smithi089 systemd[1]: Stopped Ceph mon.c for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:43:17.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:17.428 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-21T05:43:17.428 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-21T05:43:17.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.b 2024-09-21T05:43:17.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:17 smithi110 systemd[1]: Stopping Ceph mon.b for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:17.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:17 smithi110 bash[70834]: debug 2024-09-21T05:43:17.583+0000 7f7bfc514640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-21T05:43:17.737 INFO:journalctl@ceph.mon.b.smithi110.stdout:Sep 21 05:43:17 smithi110 bash[70834]: debug 2024-09-21T05:43:17.583+0000 7f7bfc514640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T05:43:18.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T05:43:18.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:18.497 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-21T05:43:18.497 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T05:43:18.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y 2024-09-21T05:43:18.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:43:18 smithi089 systemd[1]: Stopping Ceph mgr.y for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:18.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:43:18 smithi089 bash[68019]: debug 2024-09-21T05:43:18.648+0000 7f1af2795640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:18.796 INFO:journalctl@ceph.mgr.y.smithi089.stdout:Sep 21 05:43:18 smithi089 bash[68019]: debug 2024-09-21T05:43:18.648+0000 7f1af2795640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T05:43:19.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:19.049405672Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:19.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T05:43:19.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:19.597 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T05:43:19.598 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T05:43:19.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x 2024-09-21T05:43:20.010 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 21 05:43:19 smithi110 systemd[1]: Stopping Ceph mgr.x for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:20.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T05:43:20.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:20.665 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T05:43:20.665 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T05:43:20.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.0 2024-09-21T05:43:21.046 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:20 smithi089 systemd[1]: Stopping Ceph osd.0 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:21.046 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:20 smithi089 bash[98020]: debug 2024-09-21T05:43:20.816+0000 7f12a3359640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:21.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:20 smithi089 bash[98020]: debug 2024-09-21T05:43:20.816+0000 7f12a3359640 -1 osd.0 152 *** Got signal Terminated *** 2024-09-21T05:43:21.047 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:20 smithi089 bash[98020]: debug 2024-09-21T05:43:20.816+0000 7f12a3359640 -1 osd.0 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:43:22.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:22.041547167Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:25.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:25.022679062Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:27.244 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:26 smithi089 bash[124855]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-0 2024-09-21T05:43:27.244 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 21 05:43:27 smithi089 bash[124919]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-0 2024-09-21T05:43:28.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:28.05686348Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:29.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T05:43:29.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:29.337 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T05:43:29.337 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T05:43:29.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.1 2024-09-21T05:43:29.796 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:29 smithi089 systemd[1]: Stopping Ceph osd.1 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:29.796 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:29 smithi089 bash[102341]: debug 2024-09-21T05:43:29.492+0000 7f619a574640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:29.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:29 smithi089 bash[102341]: debug 2024-09-21T05:43:29.492+0000 7f619a574640 -1 osd.1 152 *** Got signal Terminated *** 2024-09-21T05:43:29.797 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:29 smithi089 bash[102341]: debug 2024-09-21T05:43:29.492+0000 7f619a574640 -1 osd.1 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:43:31.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:31.061213653Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:34.049796384Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:36.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:35 smithi089 bash[125049]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-1 2024-09-21T05:43:36.046 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 21 05:43:35 smithi089 bash[125113]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-1 2024-09-21T05:43:37.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:37.029402482Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:37.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T05:43:37.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:37.747 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T05:43:37.747 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T05:43:37.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.2 2024-09-21T05:43:38.046 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:37 smithi089 systemd[1]: Stopping Ceph osd.2 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:38.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:37 smithi089 bash[107968]: debug 2024-09-21T05:43:37.928+0000 7f1be789f640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:38.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:37 smithi089 bash[107968]: debug 2024-09-21T05:43:37.928+0000 7f1be789f640 -1 osd.2 152 *** Got signal Terminated *** 2024-09-21T05:43:38.047 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:37 smithi089 bash[107968]: debug 2024-09-21T05:43:37.928+0000 7f1be789f640 -1 osd.2 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:43:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:40.037838587Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:43.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:43.056922464Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:44.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:43 smithi089 bash[125243]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-2 2024-09-21T05:43:44.296 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 21 05:43:44 smithi089 bash[125304]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-2 2024-09-21T05:43:46.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T05:43:46.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:46.071 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T05:43:46.071 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T05:43:46.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.3 2024-09-21T05:43:46.296 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:46 smithi089 systemd[1]: Stopping Ceph osd.3 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:46.296 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:46 smithi089 bash[113472]: debug 2024-09-21T05:43:46.248+0000 7fce17222640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:46.297 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:46 smithi089 bash[113472]: debug 2024-09-21T05:43:46.248+0000 7fce17222640 -1 osd.3 152 *** Got signal Terminated *** 2024-09-21T05:43:46.297 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:46 smithi089 bash[113472]: debug 2024-09-21T05:43:46.248+0000 7fce17222640 -1 osd.3 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:43:46.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:46.027500568Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:48.804 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:48 smithi110 bash[79698]: debug 2024-09-21T05:43:48.410+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:48.805 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:48 smithi110 bash[88678]: debug 2024-09-21T05:43:48.630+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:49.404 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:49.063492788Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:49.404 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:49 smithi110 bash[84183]: debug 2024-09-21T05:43:49.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:49.804 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:49 smithi110 bash[79698]: debug 2024-09-21T05:43:49.402+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:49.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:49 smithi110 bash[88678]: debug 2024-09-21T05:43:49.602+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:50.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:49 smithi089 bash[113472]: debug 2024-09-21T05:43:49.712+0000 7fce13837640 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.156708+0000 front 2024-09-21T05:43:23.156764+0000 (oldest deadline 2024-09-21T05:43:49.056836+0000) 2024-09-21T05:43:50.385 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:50 smithi110 bash[75364]: debug 2024-09-21T05:43:50.066+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:50.386 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:50 smithi110 bash[84183]: debug 2024-09-21T05:43:50.230+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:50.637 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:50 smithi110 bash[79698]: debug 2024-09-21T05:43:50.382+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:51.038 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:50 smithi110 bash[88678]: debug 2024-09-21T05:43:50.638+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:51.046 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:50 smithi089 bash[113472]: debug 2024-09-21T05:43:50.672+0000 7fce13837640 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.156708+0000 front 2024-09-21T05:43:23.156764+0000 (oldest deadline 2024-09-21T05:43:49.056836+0000) 2024-09-21T05:43:51.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:51 smithi110 bash[75364]: debug 2024-09-21T05:43:51.038+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:51.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:51 smithi110 bash[84183]: debug 2024-09-21T05:43:51.206+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:51.670 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:51 smithi110 bash[79698]: debug 2024-09-21T05:43:51.370+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:52.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:51 smithi110 bash[88678]: debug 2024-09-21T05:43:51.666+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:52.331 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:52 smithi110 bash[75364]: debug 2024-09-21T05:43:52.070+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:52.331 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:52.067470296Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:52.332 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:52 smithi110 bash[84183]: debug 2024-09-21T05:43:52.194+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:52.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:52 smithi089 bash[125431]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-3 2024-09-21T05:43:52.546 INFO:journalctl@ceph.osd.3.smithi089.stdout:Sep 21 05:43:52 smithi089 bash[125493]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-3 2024-09-21T05:43:52.669 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:52 smithi110 bash[79698]: debug 2024-09-21T05:43:52.330+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:53.051 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:52 smithi110 bash[88678]: debug 2024-09-21T05:43:52.666+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:53.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:53 smithi110 bash[75364]: debug 2024-09-21T05:43:53.050+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:53.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:53 smithi110 bash[84183]: debug 2024-09-21T05:43:53.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:53.683 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:53 smithi110 bash[79698]: debug 2024-09-21T05:43:53.326+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:54.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:53 smithi110 bash[88678]: debug 2024-09-21T05:43:53.682+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:54.357 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[75364]: debug 2024-09-21T05:43:54.058+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:54.357 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[84183]: debug 2024-09-21T05:43:54.230+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:54.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T05:43:54.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:43:54.424 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T05:43:54.424 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T05:43:54.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.4 2024-09-21T05:43:54.725 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[79698]: debug 2024-09-21T05:43:54.354+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:54.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:54 smithi110 systemd[1]: Stopping Ceph osd.4 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:43:54.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[75364]: debug 2024-09-21T05:43:54.574+0000 7f181ec12640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:43:54.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[75364]: debug 2024-09-21T05:43:54.574+0000 7f181ec12640 -1 osd.4 152 *** Got signal Terminated *** 2024-09-21T05:43:54.726 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[75364]: debug 2024-09-21T05:43:54.574+0000 7f181ec12640 -1 osd.4 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:43:55.024 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:54 smithi110 bash[88678]: debug 2024-09-21T05:43:54.722+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:55.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:55 smithi110 bash[75364]: debug 2024-09-21T05:43:55.066+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:55.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:55 smithi110 bash[84183]: debug 2024-09-21T05:43:55.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:55.305 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:55.025525928Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:55.704 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:55 smithi110 bash[79698]: debug 2024-09-21T05:43:55.326+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:56.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:55 smithi110 bash[88678]: debug 2024-09-21T05:43:55.702+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:56.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[75364]: debug 2024-09-21T05:43:56.118+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:56.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[84183]: debug 2024-09-21T05:43:56.178+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:56.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[79698]: debug 2024-09-21T05:43:56.318+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:56.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[79698]: debug 2024-09-21T05:43:56.318+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:43:57.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[88678]: debug 2024-09-21T05:43:56.674+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:57.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:56 smithi110 bash[88678]: debug 2024-09-21T05:43:56.674+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:43:57.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[84183]: debug 2024-09-21T05:43:57.150+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:57.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[75364]: debug 2024-09-21T05:43:57.090+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:57.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[79698]: debug 2024-09-21T05:43:57.306+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:57.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[79698]: debug 2024-09-21T05:43:57.306+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:43:58.051 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[88678]: debug 2024-09-21T05:43:57.718+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:58.051 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:57 smithi110 bash[88678]: debug 2024-09-21T05:43:57.718+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:43:58.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[75364]: debug 2024-09-21T05:43:58.098+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:58.304 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[75364]: debug 2024-09-21T05:43:58.098+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.841878+0000 front 2024-09-21T05:43:32.841912+0000 (oldest deadline 2024-09-21T05:43:57.541291+0000) 2024-09-21T05:43:58.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[84183]: debug 2024-09-21T05:43:58.194+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:58.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[84183]: debug 2024-09-21T05:43:58.194+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:43:58.305 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:43:58.052215344Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:43:58.752 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[79698]: debug 2024-09-21T05:43:58.318+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:58.752 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[79698]: debug 2024-09-21T05:43:58.318+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:43:59.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[88678]: debug 2024-09-21T05:43:58.750+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:43:59.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:58 smithi110 bash[88678]: debug 2024-09-21T05:43:58.750+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:43:59.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[75364]: debug 2024-09-21T05:43:59.102+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:23.539775+0000 front 2024-09-21T05:43:23.539911+0000 (oldest deadline 2024-09-21T05:43:49.439443+0000) 2024-09-21T05:43:59.554 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[75364]: debug 2024-09-21T05:43:59.102+0000 7f181b227640 -1 osd.4 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.841878+0000 front 2024-09-21T05:43:32.841912+0000 (oldest deadline 2024-09-21T05:43:57.541291+0000) 2024-09-21T05:43:59.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[79698]: debug 2024-09-21T05:43:59.290+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:43:59.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[79698]: debug 2024-09-21T05:43:59.290+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:43:59.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[84183]: debug 2024-09-21T05:43:59.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:43:59.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[84183]: debug 2024-09-21T05:43:59.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:00.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[88678]: debug 2024-09-21T05:43:59.782+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:00.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:43:59 smithi110 bash[88678]: debug 2024-09-21T05:43:59.782+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:00.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[84183]: debug 2024-09-21T05:44:00.154+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:00.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[84183]: debug 2024-09-21T05:44:00.154+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:00.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[79698]: debug 2024-09-21T05:44:00.254+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:00.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[79698]: debug 2024-09-21T05:44:00.254+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:00.982 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[95845]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-4 2024-09-21T05:44:00.982 INFO:journalctl@ceph.osd.4.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[95909]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-4 2024-09-21T05:44:00.982 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[88678]: debug 2024-09-21T05:44:00.770+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:00.982 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[88678]: debug 2024-09-21T05:44:00.770+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.864Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=smb msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=smb\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.867Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.871Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.878Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.880Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.880Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:00.983 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:00 smithi110 bash[63390]: ts=2024-09-21T05:44:00.881Z caller=refresh.go:90 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.89:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.89:8765: connect: connection refused" 2024-09-21T05:44:01.247 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[84183]: debug 2024-09-21T05:44:01.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:01.247 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[84183]: debug 2024-09-21T05:44:01.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:01.247 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:01.027106791Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:01.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[79698]: debug 2024-09-21T05:44:01.246+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:01.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[79698]: debug 2024-09-21T05:44:01.246+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:02.043 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[88678]: debug 2024-09-21T05:44:01.738+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:02.043 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:01 smithi110 bash[88678]: debug 2024-09-21T05:44:01.738+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:02.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[79698]: debug 2024-09-21T05:44:02.206+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:02.304 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[79698]: debug 2024-09-21T05:44:02.206+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:02.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[84183]: debug 2024-09-21T05:44:02.202+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:02.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[84183]: debug 2024-09-21T05:44:02.202+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:02.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T05:44:03.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:44:03.009 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T05:44:03.009 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T05:44:03.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.5 2024-09-21T05:44:03.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[88678]: debug 2024-09-21T05:44:02.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:03.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:02 smithi110 bash[88678]: debug 2024-09-21T05:44:02.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:03.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[84183]: debug 2024-09-21T05:44:03.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:03.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[84183]: debug 2024-09-21T05:44:03.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 systemd[1]: Stopping Ceph osd.5 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[79698]: debug 2024-09-21T05:44:03.158+0000 7f1cae397640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[79698]: debug 2024-09-21T05:44:03.158+0000 7f1cae397640 -1 osd.5 152 *** Got signal Terminated *** 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[79698]: debug 2024-09-21T05:44:03.158+0000 7f1cae397640 -1 osd.5 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[79698]: debug 2024-09-21T05:44:03.182+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:03.305 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[79698]: debug 2024-09-21T05:44:03.182+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:04.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:04.022800985Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:04.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[88678]: debug 2024-09-21T05:44:03.790+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:04.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:03 smithi110 bash[88678]: debug 2024-09-21T05:44:03.790+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:04.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[79698]: debug 2024-09-21T05:44:04.138+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:04.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[79698]: debug 2024-09-21T05:44:04.138+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:04.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[84183]: debug 2024-09-21T05:44:04.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:04.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[84183]: debug 2024-09-21T05:44:04.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:04.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[84183]: debug 2024-09-21T05:44:04.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:05.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[88678]: debug 2024-09-21T05:44:04.778+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:05.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:04 smithi110 bash[88678]: debug 2024-09-21T05:44:04.778+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:05.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[79698]: debug 2024-09-21T05:44:05.126+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:05.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[79698]: debug 2024-09-21T05:44:05.126+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:05.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[84183]: debug 2024-09-21T05:44:05.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:05.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[84183]: debug 2024-09-21T05:44:05.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:05.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[84183]: debug 2024-09-21T05:44:05.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:06.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[88678]: debug 2024-09-21T05:44:05.790+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:06.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:05 smithi110 bash[88678]: debug 2024-09-21T05:44:05.790+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:06.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[79698]: debug 2024-09-21T05:44:06.086+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:06.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[79698]: debug 2024-09-21T05:44:06.086+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:06.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[84183]: debug 2024-09-21T05:44:06.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:06.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[84183]: debug 2024-09-21T05:44:06.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:06.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[84183]: debug 2024-09-21T05:44:06.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:07.108 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[88678]: debug 2024-09-21T05:44:06.810+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:07.108 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:06 smithi110 bash[88678]: debug 2024-09-21T05:44:06.810+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:07.108 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:07.030273409Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:07.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[84183]: debug 2024-09-21T05:44:07.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:07.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[84183]: debug 2024-09-21T05:44:07.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:07.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[84183]: debug 2024-09-21T05:44:07.190+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:07.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[79698]: debug 2024-09-21T05:44:07.106+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:07.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[79698]: debug 2024-09-21T05:44:07.106+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:07.555 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[79698]: debug 2024-09-21T05:44:07.106+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.170027+0000 front 2024-09-21T05:43:42.170287+0000 (oldest deadline 2024-09-21T05:44:06.869956+0000) 2024-09-21T05:44:08.142 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[88678]: debug 2024-09-21T05:44:07.822+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:08.142 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:07 smithi110 bash[88678]: debug 2024-09-21T05:44:07.822+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:08.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[79698]: debug 2024-09-21T05:44:08.142+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.965092+0000 front 2024-09-21T05:43:24.965062+0000 (oldest deadline 2024-09-21T05:43:47.864751+0000) 2024-09-21T05:44:08.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[79698]: debug 2024-09-21T05:44:08.142+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.467017+0000 front 2024-09-21T05:43:32.466635+0000 (oldest deadline 2024-09-21T05:43:55.366680+0000) 2024-09-21T05:44:08.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[79698]: debug 2024-09-21T05:44:08.142+0000 7f1ca69a4640 -1 osd.5 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.170027+0000 front 2024-09-21T05:43:42.170287+0000 (oldest deadline 2024-09-21T05:44:06.869956+0000) 2024-09-21T05:44:08.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[84183]: debug 2024-09-21T05:44:08.162+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:08.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[84183]: debug 2024-09-21T05:44:08.162+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:08.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[84183]: debug 2024-09-21T05:44:08.162+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:09.075 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[88678]: debug 2024-09-21T05:44:08.782+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:09.076 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[88678]: debug 2024-09-21T05:44:08.782+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:09.076 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:08 smithi110 bash[88678]: debug 2024-09-21T05:44:08.782+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:09.554 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[96039]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-5 2024-09-21T05:44:09.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[84183]: debug 2024-09-21T05:44:09.134+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:09.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[84183]: debug 2024-09-21T05:44:09.134+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:09.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[84183]: debug 2024-09-21T05:44:09.134+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:10.051 INFO:journalctl@ceph.osd.5.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[96101]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-5 2024-09-21T05:44:10.052 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[88678]: debug 2024-09-21T05:44:09.734+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:10.052 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[88678]: debug 2024-09-21T05:44:09.734+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:10.052 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:09 smithi110 bash[88678]: debug 2024-09-21T05:44:09.734+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:10.052719593Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:10.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[84183]: debug 2024-09-21T05:44:10.118+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:10.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[84183]: debug 2024-09-21T05:44:10.118+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:10.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[84183]: debug 2024-09-21T05:44:10.118+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:11.044 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[88678]: debug 2024-09-21T05:44:10.774+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:11.044 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[88678]: debug 2024-09-21T05:44:10.774+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:11.044 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:10 smithi110 bash[88678]: debug 2024-09-21T05:44:10.774+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:11.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.142+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:11.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.142+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:11.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.142+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:11.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T05:44:11.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:44:11.727 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T05:44:11.727 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T05:44:11.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.6 2024-09-21T05:44:11.924 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[88678]: debug 2024-09-21T05:44:11.806+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:11.925 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[88678]: debug 2024-09-21T05:44:11.806+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:11.925 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[88678]: debug 2024-09-21T05:44:11.806+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:11.925 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 systemd[1]: Stopping Ceph osd.6 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:11.925 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.922+0000 7f98ece79640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:44:12.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.922+0000 7f98ece79640 -1 osd.6 152 *** Got signal Terminated *** 2024-09-21T05:44:12.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:11 smithi110 bash[84183]: debug 2024-09-21T05:44:11.922+0000 7f98ece79640 -1 osd.6 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:44:12.304 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[84183]: debug 2024-09-21T05:44:12.146+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:12.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[84183]: debug 2024-09-21T05:44:12.146+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:12.305 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[84183]: debug 2024-09-21T05:44:12.146+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:13.189 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:13.023027628Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:13.189 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[88678]: debug 2024-09-21T05:44:12.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:13.190 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[88678]: debug 2024-09-21T05:44:12.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:13.190 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:12 smithi110 bash[88678]: debug 2024-09-21T05:44:12.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:13.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[84183]: debug 2024-09-21T05:44:13.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:13.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[84183]: debug 2024-09-21T05:44:13.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:13.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[84183]: debug 2024-09-21T05:44:13.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:13.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[84183]: debug 2024-09-21T05:44:13.186+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:48.439039+0000 front 2024-09-21T05:43:48.438957+0000 (oldest deadline 2024-09-21T05:44:12.439351+0000) 2024-09-21T05:44:14.226 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[88678]: debug 2024-09-21T05:44:13.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:14.226 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[88678]: debug 2024-09-21T05:44:13.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:14.226 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:13 smithi110 bash[88678]: debug 2024-09-21T05:44:13.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:14.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[84183]: debug 2024-09-21T05:44:14.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:14.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[84183]: debug 2024-09-21T05:44:14.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:14.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[84183]: debug 2024-09-21T05:44:14.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:14.555 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[84183]: debug 2024-09-21T05:44:14.226+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:48.439039+0000 front 2024-09-21T05:43:48.438957+0000 (oldest deadline 2024-09-21T05:44:12.439351+0000) 2024-09-21T05:44:15.199 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[88678]: debug 2024-09-21T05:44:14.802+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:15.199 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[88678]: debug 2024-09-21T05:44:14.802+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:15.200 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:14 smithi110 bash[88678]: debug 2024-09-21T05:44:14.802+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:15.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[84183]: debug 2024-09-21T05:44:15.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:15.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[84183]: debug 2024-09-21T05:44:15.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:15.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[84183]: debug 2024-09-21T05:44:15.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:15.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[84183]: debug 2024-09-21T05:44:15.198+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:48.439039+0000 front 2024-09-21T05:43:48.438957+0000 (oldest deadline 2024-09-21T05:44:12.439351+0000) 2024-09-21T05:44:16.184 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:16.022687426Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:16.184 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[88678]: debug 2024-09-21T05:44:15.814+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:16.184 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[88678]: debug 2024-09-21T05:44:15.814+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:16.185 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[88678]: debug 2024-09-21T05:44:15.814+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:16.185 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:15 smithi110 bash[88678]: debug 2024-09-21T05:44:15.814+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:16.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[84183]: debug 2024-09-21T05:44:16.182+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:21.534548+0000 front 2024-09-21T05:43:21.534632+0000 (oldest deadline 2024-09-21T05:43:49.135241+0000) 2024-09-21T05:44:16.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[84183]: debug 2024-09-21T05:44:16.182+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:32.036724+0000 front 2024-09-21T05:43:32.036509+0000 (oldest deadline 2024-09-21T05:43:57.936363+0000) 2024-09-21T05:44:16.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[84183]: debug 2024-09-21T05:44:16.182+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:37.937096+0000 front 2024-09-21T05:43:37.937277+0000 (oldest deadline 2024-09-21T05:44:03.837056+0000) 2024-09-21T05:44:16.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[84183]: debug 2024-09-21T05:44:16.182+0000 7f98e5486640 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:48.439039+0000 front 2024-09-21T05:43:48.438957+0000 (oldest deadline 2024-09-21T05:44:12.439351+0000) 2024-09-21T05:44:17.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[88678]: debug 2024-09-21T05:44:16.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:17.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[88678]: debug 2024-09-21T05:44:16.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:17.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[88678]: debug 2024-09-21T05:44:16.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:17.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:16 smithi110 bash[88678]: debug 2024-09-21T05:44:16.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:18.166 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:17 smithi110 bash[96233]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-6 2024-09-21T05:44:18.166 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:17 smithi110 bash[88678]: debug 2024-09-21T05:44:17.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:18.166 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:17 smithi110 bash[88678]: debug 2024-09-21T05:44:17.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:18.166 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:17 smithi110 bash[88678]: debug 2024-09-21T05:44:17.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:18.166 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:17 smithi110 bash[88678]: debug 2024-09-21T05:44:17.838+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:18.554 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 21 05:44:18 smithi110 bash[96299]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-6 2024-09-21T05:44:19.283 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:19 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:19.035063322Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:19.284 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:18 smithi110 bash[88678]: debug 2024-09-21T05:44:18.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:19.284 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:18 smithi110 bash[88678]: debug 2024-09-21T05:44:18.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:19.284 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:18 smithi110 bash[88678]: debug 2024-09-21T05:44:18.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:19.284 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:18 smithi110 bash[88678]: debug 2024-09-21T05:44:18.834+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:20.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:19 smithi110 bash[88678]: debug 2024-09-21T05:44:19.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:20.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:19 smithi110 bash[88678]: debug 2024-09-21T05:44:19.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:20.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:19 smithi110 bash[88678]: debug 2024-09-21T05:44:19.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:20.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:19 smithi110 bash[88678]: debug 2024-09-21T05:44:19.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:20.212 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T05:44:20.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:44:20.240 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T05:44:20.240 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T05:44:20.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.7 2024-09-21T05:44:20.554 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 systemd[1]: Stopping Ceph osd.7 for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:20.554 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.442+0000 7f39a902e640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-21T05:44:20.554 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.442+0000 7f39a902e640 -1 osd.7 152 *** Got signal Terminated *** 2024-09-21T05:44:20.555 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.442+0000 7f39a902e640 -1 osd.7 152 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T05:44:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:21.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:21.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:20 smithi110 bash[88678]: debug 2024-09-21T05:44:20.758+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:22.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:22.021916797Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:22.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:21 smithi110 bash[88678]: debug 2024-09-21T05:44:21.786+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:22.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:21 smithi110 bash[88678]: debug 2024-09-21T05:44:21.786+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:22.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:21 smithi110 bash[88678]: debug 2024-09-21T05:44:21.786+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:22.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:21 smithi110 bash[88678]: debug 2024-09-21T05:44:21.786+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:23.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[88678]: debug 2024-09-21T05:44:22.798+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:23.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[88678]: debug 2024-09-21T05:44:22.798+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:23.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[88678]: debug 2024-09-21T05:44:22.798+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:23.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[88678]: debug 2024-09-21T05:44:22.798+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:23.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:22 smithi110 bash[88678]: debug 2024-09-21T05:44:22.798+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.110:6804 osd.4 since back 2024-09-21T05:43:57.705377+0000 front 2024-09-21T05:43:57.705324+0000 (oldest deadline 2024-09-21T05:44:21.805187+0000) 2024-09-21T05:44:24.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:23 smithi110 bash[88678]: debug 2024-09-21T05:44:23.830+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:24.304 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:23 smithi110 bash[88678]: debug 2024-09-21T05:44:23.830+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:24.305 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:23 smithi110 bash[88678]: debug 2024-09-21T05:44:23.830+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:24.305 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:23 smithi110 bash[88678]: debug 2024-09-21T05:44:23.830+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:24.305 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:23 smithi110 bash[88678]: debug 2024-09-21T05:44:23.830+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.110:6804 osd.4 since back 2024-09-21T05:43:57.705377+0000 front 2024-09-21T05:43:57.705324+0000 (oldest deadline 2024-09-21T05:44:21.805187+0000) 2024-09-21T05:44:25.054 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:25 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:25.02677194Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:25.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:24 smithi110 bash[88678]: debug 2024-09-21T05:44:24.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-21T05:43:24.894916+0000 front 2024-09-21T05:43:24.894972+0000 (oldest deadline 2024-09-21T05:43:48.395165+0000) 2024-09-21T05:44:25.054 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:24 smithi110 bash[88678]: debug 2024-09-21T05:44:24.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-21T05:43:34.098809+0000 front 2024-09-21T05:43:34.098831+0000 (oldest deadline 2024-09-21T05:43:55.798427+0000) 2024-09-21T05:44:25.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:24 smithi110 bash[88678]: debug 2024-09-21T05:44:24.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-21T05:43:42.602196+0000 front 2024-09-21T05:43:42.602140+0000 (oldest deadline 2024-09-21T05:44:07.902099+0000) 2024-09-21T05:44:25.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:24 smithi110 bash[88678]: debug 2024-09-21T05:44:24.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.89:6830 osd.3 since back 2024-09-21T05:43:47.902990+0000 front 2024-09-21T05:43:47.903341+0000 (oldest deadline 2024-09-21T05:44:14.903349+0000) 2024-09-21T05:44:25.055 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:24 smithi110 bash[88678]: debug 2024-09-21T05:44:24.794+0000 7f39a163b640 -1 osd.7 152 heartbeat_check: no reply from 172.21.15.110:6804 osd.4 since back 2024-09-21T05:43:57.705377+0000 front 2024-09-21T05:43:57.705324+0000 (oldest deadline 2024-09-21T05:44:21.805187+0000) 2024-09-21T05:44:26.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:26 smithi110 bash[96428]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-7 2024-09-21T05:44:26.804 INFO:journalctl@ceph.osd.7.smithi110.stdout:Sep 21 05:44:26 smithi110 bash[96492]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-osd-7 2024-09-21T05:44:28.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:28.04634237Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:28.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T05:44:28.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:44:28.347 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T05:44:28.347 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-21T05:44:28.347 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a 2024-09-21T05:44:28.701 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 systemd[1]: Stopping Ceph prometheus.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:28.701 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:44:28.701 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-21T05:44:28.701 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.519Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.520Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.521Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-21T05:44:28.702 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.521Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-21T05:44:28.703 INFO:journalctl@ceph.prometheus.a.smithi110.stdout:Sep 21 05:44:28 smithi110 bash[63390]: ts=2024-09-21T05:44:28.521Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-21T05:44:29.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@prometheus.a.service' 2024-09-21T05:44:29.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T05:44:29.306 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-21T05:44:29.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T05:44:29.488 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:44:31.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:31 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:31.030339961Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:34.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:34 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:34.026805774Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:34.365 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:34.366 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:34.625 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:34.626 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:34.966 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:34.967 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.267 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.267 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.268 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:34 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.268 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.546 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.546 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.905 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.905 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:35.905 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:35 smithi089 systemd[1]: Stopping Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:36.760 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 bash[125891]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-a 2024-09-21T05:44:36.760 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 bash[125953]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-a 2024-09-21T05:44:36.760 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:44:36.760 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-21T05:44:36.761 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: Stopped Ceph node-exporter.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:44:37.018 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:37.018 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: Stopping Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:44:37.018 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:36 smithi089 bash[82342]: ts=2024-09-21T05:44:36.979Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-21T05:44:37.019 INFO:journalctl@ceph.node-exporter.a.smithi089.stdout:Sep 21 05:44:36 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:37.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:37 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:37.057661439Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:37.796 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:37 smithi089 bash[126022]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:44:37.796 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:37 smithi089 bash[126081]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-alertmanager-a 2024-09-21T05:44:37.796 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:37 smithi089 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@alertmanager.a.service: Deactivated successfully. 2024-09-21T05:44:37.796 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:37 smithi089 systemd[1]: Stopped Ceph alertmanager.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:44:38.296 INFO:journalctl@ceph.alertmanager.a.smithi089.stdout:Sep 21 05:44:37 smithi089 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:44:40.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:40 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:40.029215601Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:43.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:43 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:43.043959856Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:46.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:46 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:46.060470892Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:49.306 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:49 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:49.041843715Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:52.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:52 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:52.022444676Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:55.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:55 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:55.035764099Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:44:58.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:44:58 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:44:58.055288585Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:45:01.554 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:01 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:45:01.059207731Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:45:01.558 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T05:45:01.740 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:45:04.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:04 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:45:04.023029088Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:45:06.591 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:06.591 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:06.926 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:06.927 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.206 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.207 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.207 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:06 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.207 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:07 smithi110 bash[67424]: logger=provisioning.dashboard type=file name="Ceph Dashboard" t=2024-09-21T05:45:07.024062738Z level=error msg="failed to save dashboard" file=/etc/grafana/provisioning/dashboards/ceph-cluster.json error="could not resolve dashboards:uid:edtb0oxdq: Dashboard not found" 2024-09-21T05:45:07.207 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.516 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.517 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.804 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:07.804 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:08.135 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:08.135 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:08.135 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:07 smithi110 systemd[1]: Stopping Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:45:08.934 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 bash[96995]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-b 2024-09-21T05:45:08.934 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-21T05:45:08.934 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 bash[97056]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-node-exporter-b 2024-09-21T05:45:08.934 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-21T05:45:08.935 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 systemd[1]: Stopped Ceph node-exporter.b for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:45:09.202 INFO:journalctl@ceph.node-exporter.b.smithi110.stdout:Sep 21 05:45:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:09.202 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:08 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:09.202 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 systemd[1]: Stopping Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490... 2024-09-21T05:45:09.202 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[67424]: logger=server t=2024-09-21T05:45:09.165455749Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-21T05:45:09.202 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[67424]: logger=ticker t=2024-09-21T05:45:09.165541264Z level=info msg=stopped last_tick=2024-09-21T05:45:00Z 2024-09-21T05:45:09.202 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[67424]: logger=tracing t=2024-09-21T05:45:09.165560255Z level=info msg="Closing tracing" 2024-09-21T05:45:09.203 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[67424]: logger=grafana-apiserver t=2024-09-21T05:45:09.165594916Z level=info msg="StorageObjectCountTracker pruner is exiting" 2024-09-21T05:45:10.020 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[97125]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-grafana-a 2024-09-21T05:45:10.021 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 bash[97186]: Error response from daemon: No such container: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490-grafana-a 2024-09-21T05:45:10.021 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 systemd[1]: ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@grafana.a.service: Deactivated successfully. 2024-09-21T05:45:10.021 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:09 smithi110 systemd[1]: Stopped Ceph grafana.a for bfdfee20-77d4-11ef-baf5-efdc52797490. 2024-09-21T05:45:10.304 INFO:journalctl@ceph.grafana.a.smithi110.stdout:Sep 21 05:45:10 smithi110 systemd[1]: /etc/systemd/system/ceph-bfdfee20-77d4-11ef-baf5-efdc52797490@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-21T05:45:21.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:21.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T05:45:21.717 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T05:45:21.720 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi089/crash 2024-09-21T05:45:21.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash -- . 2024-09-21T05:45:21.760 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T05:45:21.760 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-21T05:45:21.762 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi110/crash 2024-09-21T05:45:21.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash -- . 2024-09-21T05:45:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T05:45:21.773 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2024-09-21T05:45:21.774 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T05:45:21.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v CEPHADM_STRAY_DAEMON | egrep -v CEPHADM_FAILED_DAEMON | egrep -v CEPHADM_AGENT_DOWN | head -n 1 2024-09-21T05:45:21.818 INFO:tasks.cephadm:Compressing logs... 2024-09-21T05:45:21.819 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T05:45:21.861 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T05:45:21.869 INFO:teuthology.orchestra.run.smithi089.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-21T05:45:21.876 INFO:teuthology.orchestra.run.smithi110.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-21T05:45:21.882 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T05:45:21.884 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T05:45:21.884 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T05:45:21.884 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T05:45:21.885 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T05:45:21.885 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T05:45:21.887 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T05:45:21.887 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T05:45:21.888 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/tcmu-runner.log 2024-09-21T05:45:21.888 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.1.log: 92.1% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T05:45:21.888 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi089.siazst.log 2024-09-21T05:45:21.889 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/tcmu-runner.log: 64.1% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/tcmu-runner.log.gz 2024-09-21T05:45:21.889 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log 2024-09-21T05:45:21.890 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi089.siazst.log: 77.3% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi089.siazst.log.gz 2024-09-21T05:45:21.891 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T05:45:21.891 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T05:45:21.891 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi110.bcgqia.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T05:45:21.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi110.bcgqia.log: 86.0%gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log 2024-09-21T05:45:21.894 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T05:45:21.894 INFO:teuthology.orchestra.run.smithi110.stderr: 77.3% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-client.rgw.foo.smithi110.bcgqia.log.gzgzip -5 --verbose --/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.x.log: /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T05:45:21.894 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-21T05:45:21.894 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T05:45:21.895 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T05:45:21.899 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log: 89.6% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T05:45:21.899 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log: 94.2% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T05:45:21.899 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T05:45:21.900 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T05:45:21.902 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T05:45:21.919 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log: 91.5% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T05:45:21.922 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.4.log: 91.5% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T05:45:21.925 INFO:teuthology.orchestra.run.smithi089.stderr: 94.4% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T05:45:21.930 INFO:teuthology.orchestra.run.smithi110.stderr: 90.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T05:45:22.000 INFO:teuthology.orchestra.run.smithi110.stderr: 90.1% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T05:45:22.438 INFO:teuthology.orchestra.run.smithi089.stderr: 90.0% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T05:45:22.583 INFO:teuthology.orchestra.run.smithi110.stderr: 92.7% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T05:45:22.786 INFO:teuthology.orchestra.run.smithi089.stderr: 92.6% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T05:45:23.355 INFO:teuthology.orchestra.run.smithi089.stderr: 93.1% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T05:45:23.845 INFO:teuthology.orchestra.run.smithi089.stderr: 91.0% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T05:45:23.896 INFO:teuthology.orchestra.run.smithi110.stderr: 93.2% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T05:45:24.211 INFO:teuthology.orchestra.run.smithi110.stderr: 93.3% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T05:45:24.318 INFO:teuthology.orchestra.run.smithi089.stderr: 93.5% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T05:45:24.376 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T05:45:24.463 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T05:45:24.708 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T05:45:24.709 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-21T05:45:24.709 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m2.843s 2024-09-21T05:45:24.709 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m10.160s 2024-09-21T05:45:24.709 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.364s 2024-09-21T05:45:25.062 INFO:teuthology.orchestra.run.smithi089.stderr: 93.3% -- replaced with /var/log/ceph/bfdfee20-77d4-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T05:45:25.064 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-21T05:45:25.064 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m3.201s 2024-09-21T05:45:25.064 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m12.673s 2024-09-21T05:45:25.065 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.466s 2024-09-21T05:45:25.065 INFO:tasks.cephadm:Archiving logs... 2024-09-21T05:45:25.066 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi089/log 2024-09-21T05:45:25.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T05:45:26.518 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi110/log 2024-09-21T05:45:26.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T05:45:27.701 INFO:tasks.cephadm:Removing cluster... 2024-09-21T05:45:27.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 --force 2024-09-21T05:45:27.877 INFO:teuthology.orchestra.run.smithi089.stdout:Deleting cluster with fsid: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:45:29.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 --force 2024-09-21T05:45:29.194 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: bfdfee20-77d4-11ef-baf5-efdc52797490 2024-09-21T05:45:30.334 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T05:45:30.334 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T05:45:30.340 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T05:45:30.345 INFO:tasks.cephadm:Teardown complete 2024-09-21T05:45:30.346 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T05:45:30.355 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T05:45:30.356 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:45:30.385 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T05:45:30.394 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T05:45:30.395 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2024-09-21T05:45:30.395 INFO:teuthology.orchestra.run.smithi089.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.090 -2.272 0.441 2024-09-21T05:45:30.395 INFO:teuthology.orchestra.run.smithi089.stdout:+hv02.front.sepi 96.245.170.99 3 u 14 64 377 0.085 -3.423 0.330 2024-09-21T05:45:30.395 INFO:teuthology.orchestra.run.smithi089.stdout:+hv03.front.sepi 74.6.168.72 3 u 6 64 377 0.087 -1.500 0.266 2024-09-21T05:45:30.395 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-21T05:45:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T05:45:30.401 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-21T05:45:30.401 INFO:teuthology.orchestra.run.smithi110.stdout:*hv01.front.sepi 67.205.162.81 3 u 212 256 377 0.197 -2.564 0.134 2024-09-21T05:45:30.401 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 96.245.170.99 3 u 83 256 377 0.181 -3.935 0.249 2024-09-21T05:45:30.402 INFO:teuthology.orchestra.run.smithi110.stdout:+hv03.front.sepi 74.6.168.72 3 u 255 256 377 0.179 -2.296 0.094 2024-09-21T05:45:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-21T05:45:30.402 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T05:45:30.411 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T05:45:30.411 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T05:45:30.419 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T05:45:30.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T05:45:30.435 INFO:teuthology.task.internal:Duration was 3876.255412 seconds 2024-09-21T05:45:30.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T05:45:30.443 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T05:45:30.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T05:45:30.446 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T05:45:30.484 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T05:45:30.484 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T05:45:30.484 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T05:45:30.537 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-21T05:45:30.537 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T05:45:30.547 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T05:45:30.547 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T05:45:30.581 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T05:45:30.659 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T05:45:30.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T05:45:30.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T05:45:30.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T05:45:30.924 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T05:45:30.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T05:45:30.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T05:45:30.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T05:45:30.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:45:30.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:45:30.989 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-21T05:45:31.004 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-21T05:45:31.034 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:45:31.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:45:31.064 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T05:45:31.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:45:31.081 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T05:45:31.090 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T05:45:31.091 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi089 2024-09-21T05:45:31.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T05:45:31.138 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_03:44:43-orch:cephadm-wip-guits-main-2024-09-20-2310-distro-default-smithi/7913729/remote/smithi110 2024-09-21T05:45:31.138 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T05:45:31.165 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T05:45:31.165 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T05:45:31.177 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T05:45:31.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T05:45:31.216 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T05:45:31.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T05:45:31.225 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T05:45:31.225 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T05:45:31.228 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T05:45:31.231 INFO:teuthology.orchestra.run.smithi089.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 05:45 /home/ubuntu/cephtest 2024-09-21T05:45:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: 655474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 05:45 /home/ubuntu/cephtest 2024-09-21T05:45:31.255 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T05:45:31.265 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T05:45:31.288 INFO:teuthology.run:Summary data: description: orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} duration: 3876.255412340164 failure_reason: 'Command failed on smithi089 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfdfee20-77d4-11ef-baf5-efdc52797490 -e sha1=f36283e7c91cac1c01cb9a7c4ff21bd697dbd4f2 -- bash -c \''ceph versions | jq -e \''"\''"\''.rgw | length == 1\''"\''"\''\''''' owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=94a2f0c3b77f45439ca5cf44f0efa99b status: fail success: false 2024-09-21T05:45:31.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:45:31.358 INFO:teuthology.run:FAIL